2023-11-10 10:52:45,717 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-10 10:52:45,949 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc 2023-11-10 10:52:45,965 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-10 10:52:45,966 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17, deleteOnExit=true 2023-11-10 10:52:45,966 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-10 10:52:45,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/test.cache.data in system properties and HBase conf 2023-11-10 10:52:45,967 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/hadoop.tmp.dir in system properties and HBase conf 2023-11-10 10:52:45,968 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/hadoop.log.dir in system properties and HBase conf 2023-11-10 10:52:45,968 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-10 10:52:45,969 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-10 10:52:45,969 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-10 10:52:46,080 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-10 10:52:46,431 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-10 10:52:46,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-10 10:52:46,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-10 10:52:46,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-10 10:52:46,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-10 10:52:46,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-10 10:52:46,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-10 10:52:46,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-10 10:52:46,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-10 10:52:46,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-10 10:52:46,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/nfs.dump.dir in system properties and HBase conf 2023-11-10 10:52:46,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/java.io.tmpdir in system properties and HBase conf 2023-11-10 10:52:46,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-10 10:52:46,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-10 10:52:46,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-10 10:52:46,981 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-10 10:52:46,987 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-10 10:52:47,276 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-10 10:52:47,436 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-10 10:52:47,449 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-10 10:52:47,477 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-10 10:52:47,502 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/java.io.tmpdir/Jetty_localhost_38213_hdfs____.euh69z/webapp 2023-11-10 10:52:47,603 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38213 2023-11-10 10:52:47,610 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-10 10:52:47,611 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-10 10:52:47,972 WARN [Listener at localhost/38297] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-10 10:52:48,026 WARN [Listener at localhost/38297] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-10 10:52:48,042 WARN [Listener at localhost/38297] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-10 10:52:48,048 INFO [Listener at localhost/38297] log.Slf4jLog(67): jetty-6.1.26 2023-11-10 10:52:48,052 INFO [Listener at localhost/38297] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/java.io.tmpdir/Jetty_localhost_33257_datanode____ajvkkb/webapp 2023-11-10 10:52:48,126 INFO [Listener at localhost/38297] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33257 2023-11-10 10:52:48,377 WARN [Listener at localhost/37195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-10 10:52:48,702 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd62d9d16abc2c08: Processing first storage report for DS-600d98fc-9b09-469d-8748-7bbfcfb44485 from datanode 9f6465db-8ff1-4abd-ab07-c6e7ffad8768 2023-11-10 10:52:48,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd62d9d16abc2c08: from storage DS-600d98fc-9b09-469d-8748-7bbfcfb44485 node DatanodeRegistration(127.0.0.1:40667, datanodeUuid=9f6465db-8ff1-4abd-ab07-c6e7ffad8768, infoPort=36747, infoSecurePort=0, ipcPort=37195, storageInfo=lv=-57;cid=testClusterID;nsid=1998033798;c=1699613567068), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-11-10 10:52:48,703 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd62d9d16abc2c08: Processing first storage report for DS-37bf71ab-4aa3-448a-b51c-cc105128f275 from datanode 9f6465db-8ff1-4abd-ab07-c6e7ffad8768 2023-11-10 10:52:48,703 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd62d9d16abc2c08: from storage DS-37bf71ab-4aa3-448a-b51c-cc105128f275 node DatanodeRegistration(127.0.0.1:40667, datanodeUuid=9f6465db-8ff1-4abd-ab07-c6e7ffad8768, infoPort=36747, infoSecurePort=0, ipcPort=37195, storageInfo=lv=-57;cid=testClusterID;nsid=1998033798;c=1699613567068), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-10 10:52:48,712 DEBUG [Listener at localhost/37195] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc 2023-11-10 10:52:48,811 INFO [Listener at localhost/37195] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/zookeeper_0, clientPort=62972, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-10 10:52:48,826 INFO [Listener at localhost/37195] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62972 2023-11-10 10:52:48,833 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:48,834 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:49,455 INFO [Listener at localhost/37195] util.FSUtils(471): Created version file at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1 with version=8 2023-11-10 10:52:49,456 INFO [Listener at localhost/37195] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/hbase-staging 2023-11-10 10:52:49,699 INFO [Listener at localhost/37195] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-10 10:52:50,063 INFO [Listener at localhost/37195] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-11-10 10:52:50,088 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-10 10:52:50,088 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-10 10:52:50,088 INFO [Listener at localhost/37195] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-10 10:52:50,088 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-10 10:52:50,088 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-10 10:52:50,206 INFO [Listener at localhost/37195] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-10 10:52:50,263 DEBUG [Listener at localhost/37195] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-10 10:52:50,337 INFO [Listener at localhost/37195] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35827 2023-11-10 10:52:50,346 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:50,348 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:50,367 INFO [Listener at localhost/37195] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35827 connecting to ZooKeeper ensemble=127.0.0.1:62972 2023-11-10 10:52:50,401 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:358270x0, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-10 10:52:50,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35827-0x101bb1fc0340000 connected 2023-11-10 10:52:50,431 DEBUG [Listener at localhost/37195] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-10 10:52:50,432 DEBUG [Listener at localhost/37195] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-10 10:52:50,436 DEBUG [Listener at localhost/37195] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-10 10:52:50,445 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35827 2023-11-10 10:52:50,445 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35827 2023-11-10 10:52:50,445 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35827 2023-11-10 10:52:50,446 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35827 2023-11-10 10:52:50,446 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35827 2023-11-10 10:52:50,451 INFO [Listener at localhost/37195] master.HMaster(444): hbase.rootdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1, hbase.cluster.distributed=false 2023-11-10 10:52:50,511 INFO [Listener at localhost/37195] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-11-10 10:52:50,511 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-10 10:52:50,511 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-10 10:52:50,511 INFO [Listener at localhost/37195] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-10 10:52:50,511 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-10 10:52:50,511 INFO [Listener at localhost/37195] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-10 10:52:50,515 INFO [Listener at localhost/37195] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-10 10:52:50,518 INFO [Listener at localhost/37195] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43721 2023-11-10 10:52:50,519 INFO [Listener at localhost/37195] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-10 10:52:50,524 DEBUG [Listener at localhost/37195] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-10 10:52:50,525 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:50,528 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:50,530 INFO [Listener at localhost/37195] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43721 connecting to ZooKeeper ensemble=127.0.0.1:62972 2023-11-10 10:52:50,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:437210x0, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-10 10:52:50,535 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43721-0x101bb1fc0340001 connected 2023-11-10 10:52:50,535 DEBUG [Listener at localhost/37195] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-10 10:52:50,536 DEBUG [Listener at localhost/37195] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-10 10:52:50,537 DEBUG [Listener at localhost/37195] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-10 10:52:50,538 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43721 2023-11-10 10:52:50,538 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43721 2023-11-10 10:52:50,539 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43721 2023-11-10 10:52:50,539 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43721 2023-11-10 10:52:50,539 DEBUG [Listener at localhost/37195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43721 2023-11-10 10:52:50,542 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:50,550 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-10 10:52:50,553 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:50,572 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-10 10:52:50,572 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-10 10:52:50,573 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:50,573 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-10 10:52:50,575 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,35827,1699613569566 from backup master directory 2023-11-10 10:52:50,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-10 10:52:50,577 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:50,577 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-10 10:52:50,578 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-10 10:52:50,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:50,581 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-10 10:52:50,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-10 10:52:50,663 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/hbase.id with ID: e696cbec-93e7-4d68-8434-05c445815b14 2023-11-10 10:52:50,704 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:50,720 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:50,755 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x78f64792 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:52:50,783 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ba557ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:52:50,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-10 10:52:50,804 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-10 10:52:50,822 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-10 10:52:50,822 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-10 10:52:50,824 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-10 10:52:50,827 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-10 10:52:50,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-10 10:52:50,855 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store-tmp 2023-11-10 10:52:51,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:51,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-10 10:52:51,288 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:52:51,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:52:51,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-10 10:52:51,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:52:51,288 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:52:51,288 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-10 10:52:51,290 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/WALs/jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:51,309 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35827%2C1699613569566, suffix=, logDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/WALs/jenkins-hbase20.apache.org,35827,1699613569566, archiveDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/oldWALs, maxLogs=10 2023-11-10 10:52:51,357 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-600d98fc-9b09-469d-8748-7bbfcfb44485,DISK] 2023-11-10 10:52:51,363 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-10 10:52:51,413 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/WALs/jenkins-hbase20.apache.org,35827,1699613569566/jenkins-hbase20.apache.org%2C35827%2C1699613569566.1699613571318 2023-11-10 10:52:51,414 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40667,DS-600d98fc-9b09-469d-8748-7bbfcfb44485,DISK]] 2023-11-10 10:52:51,414 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:52:51,414 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:51,417 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-10 10:52:51,418 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-10 10:52:51,466 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-10 10:52:51,472 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-10 10:52:51,494 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-10 10:52:51,504 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:51,509 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-10 10:52:51,511 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-10 10:52:51,525 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-10 10:52:51,529 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:52:51,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61511338, jitterRate=-0.0834096372127533}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:52:51,530 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-10 10:52:51,532 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-10 10:52:51,548 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-10 10:52:51,549 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-10 10:52:51,551 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-10 10:52:51,552 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-10 10:52:51,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 26 msec 2023-11-10 10:52:51,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-10 10:52:51,600 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-10 10:52:51,604 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-10 10:52:51,625 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-10 10:52:51,628 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-10 10:52:51,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-10 10:52:51,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-10 10:52:51,639 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-10 10:52:51,642 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:51,643 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-10 10:52:51,644 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-10 10:52:51,655 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-10 10:52:51,659 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-10 10:52:51,659 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-10 10:52:51,659 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:51,660 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,35827,1699613569566, sessionid=0x101bb1fc0340000, setting cluster-up flag (Was=false) 2023-11-10 10:52:51,676 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:51,680 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-10 10:52:51,682 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:51,701 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:51,725 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-10 10:52:51,727 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:51,729 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp 2023-11-10 10:52:51,744 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(951): ClusterId : e696cbec-93e7-4d68-8434-05c445815b14 2023-11-10 10:52:51,747 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-10 10:52:51,752 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-10 10:52:51,752 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-10 10:52:51,756 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-10 10:52:51,758 DEBUG [RS:0;jenkins-hbase20:43721] zookeeper.ReadOnlyZKClient(139): Connect 0x728ee08d to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:52:51,768 DEBUG [RS:0;jenkins-hbase20:43721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c4910ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:52:51,769 DEBUG [RS:0;jenkins-hbase20:43721] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78768bfd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-11-10 10:52:51,789 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43721 2023-11-10 10:52:51,793 INFO [RS:0;jenkins-hbase20:43721] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-10 10:52:51,793 INFO [RS:0;jenkins-hbase20:43721] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-10 10:52:51,793 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1022): About to register with Master. 2023-11-10 10:52:51,796 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,35827,1699613569566 with isa=jenkins-hbase20.apache.org/148.251.75.209:43721, startcode=1699613570510 2023-11-10 10:52:51,809 DEBUG [RS:0;jenkins-hbase20:43721] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-10 10:52:51,836 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-10 10:52:51,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-10 10:52:51,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-10 10:52:51,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-10 10:52:51,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-10 10:52:51,847 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-11-10 10:52:51,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:51,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-11-10 10:52:51,848 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:51,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699613601849 2023-11-10 10:52:51,850 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-10 10:52:51,855 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49241, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-10 10:52:51,856 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-10 10:52:51,856 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-10 10:52:51,861 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-10 10:52:51,862 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-10 10:52:51,864 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35827] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-11-10 10:52:51,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-10 10:52:51,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-10 10:52:51,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-10 10:52:51,870 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-10 10:52:51,871 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:51,872 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-10 10:52:51,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-10 10:52:51,874 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-10 10:52:51,876 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-10 10:52:51,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-10 10:52:51,878 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699613571878,5,FailOnTimeoutGroup] 2023-11-10 10:52:51,880 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699613571878,5,FailOnTimeoutGroup] 2023-11-10 10:52:51,880 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:51,880 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-10 10:52:51,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:51,881 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:51,893 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-10 10:52:51,894 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-10 10:52:51,894 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1 2023-11-10 10:52:51,896 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(2830): Master is not running yet 2023-11-10 10:52:51,896 WARN [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-11-10 10:52:51,998 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,35827,1699613569566 with isa=jenkins-hbase20.apache.org/148.251.75.209:43721, startcode=1699613570510 2023-11-10 10:52:52,011 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35827] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,016 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1 2023-11-10 10:52:52,016 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:38297 2023-11-10 10:52:52,016 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-10 10:52:52,021 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-10 10:52:52,021 DEBUG [RS:0;jenkins-hbase20:43721] zookeeper.ZKUtil(162): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,022 WARN [RS:0;jenkins-hbase20:43721] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-10 10:52:52,022 INFO [RS:0;jenkins-hbase20:43721] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-10 10:52:52,023 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1948): logDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/WALs/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,023 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43721,1699613570510] 2023-11-10 10:52:52,032 DEBUG [RS:0;jenkins-hbase20:43721] zookeeper.ZKUtil(162): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,043 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-10 10:52:52,049 INFO [RS:0;jenkins-hbase20:43721] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-10 10:52:52,065 INFO [RS:0;jenkins-hbase20:43721] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-10 10:52:52,068 INFO [RS:0;jenkins-hbase20:43721] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:52:52,068 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,069 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-10 10:52:52,074 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,075 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,075 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,075 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,075 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,075 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,075 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-11-10 10:52:52,076 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,076 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,076 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,076 DEBUG [RS:0;jenkins-hbase20:43721] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-10 10:52:52,077 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,077 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,077 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,089 INFO [RS:0;jenkins-hbase20:43721] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-10 10:52:52,091 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43721,1699613570510-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,104 INFO [RS:0;jenkins-hbase20:43721] regionserver.Replication(203): jenkins-hbase20.apache.org,43721,1699613570510 started 2023-11-10 10:52:52,104 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,43721,1699613570510, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43721, sessionid=0x101bb1fc0340001 2023-11-10 10:52:52,105 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-10 10:52:52,105 DEBUG [RS:0;jenkins-hbase20:43721] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,105 DEBUG [RS:0;jenkins-hbase20:43721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43721,1699613570510' 2023-11-10 10:52:52,105 DEBUG [RS:0;jenkins-hbase20:43721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:52,106 DEBUG [RS:0;jenkins-hbase20:43721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:52,107 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-10 10:52:52,107 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-10 10:52:52,107 DEBUG [RS:0;jenkins-hbase20:43721] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,107 DEBUG [RS:0;jenkins-hbase20:43721] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43721,1699613570510' 2023-11-10 10:52:52,107 DEBUG [RS:0;jenkins-hbase20:43721] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-10 10:52:52,107 DEBUG [RS:0;jenkins-hbase20:43721] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-10 10:52:52,108 DEBUG [RS:0;jenkins-hbase20:43721] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-10 10:52:52,108 INFO [RS:0;jenkins-hbase20:43721] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-10 10:52:52,108 INFO [RS:0;jenkins-hbase20:43721] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-10 10:52:52,223 INFO [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43721%2C1699613570510, suffix=, logDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/WALs/jenkins-hbase20.apache.org,43721,1699613570510, archiveDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/oldWALs, maxLogs=32 2023-11-10 10:52:52,238 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-600d98fc-9b09-469d-8748-7bbfcfb44485,DISK] 2023-11-10 10:52:52,242 INFO [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/WALs/jenkins-hbase20.apache.org,43721,1699613570510/jenkins-hbase20.apache.org%2C43721%2C1699613570510.1699613572225 2023-11-10 10:52:52,242 DEBUG [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40667,DS-600d98fc-9b09-469d-8748-7bbfcfb44485,DISK]] 2023-11-10 10:52:52,305 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:52,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-10 10:52:52,313 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/info 2023-11-10 10:52:52,314 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-10 10:52:52,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:52,316 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-10 10:52:52,319 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/rep_barrier 2023-11-10 10:52:52,320 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-10 10:52:52,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:52,321 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-10 10:52:52,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/table 2023-11-10 10:52:52,324 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-10 10:52:52,325 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:52,327 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740 2023-11-10 10:52:52,328 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740 2023-11-10 10:52:52,331 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-10 10:52:52,333 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-10 10:52:52,337 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:52:52,338 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65809636, jitterRate=-0.019360005855560303}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-10 10:52:52,338 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-10 10:52:52,338 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-10 10:52:52,338 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-10 10:52:52,338 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-10 10:52:52,338 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-10 10:52:52,338 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-10 10:52:52,340 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-10 10:52:52,340 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-10 10:52:52,345 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-10 10:52:52,345 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-10 10:52:52,352 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-10 10:52:52,363 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-10 10:52:52,367 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-10 10:52:52,520 DEBUG [jenkins-hbase20:35827] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-10 10:52:52,524 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43721,1699613570510, state=OPENING 2023-11-10 10:52:52,535 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-10 10:52:52,536 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:52,537 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-10 10:52:52,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:52:52,725 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:52,727 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-10 10:52:52,730 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-10 10:52:52,741 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-10 10:52:52,742 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-10 10:52:52,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43721%2C1699613570510.meta, suffix=.meta, logDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/WALs/jenkins-hbase20.apache.org,43721,1699613570510, archiveDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/oldWALs, maxLogs=32 2023-11-10 10:52:52,760 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40667,DS-600d98fc-9b09-469d-8748-7bbfcfb44485,DISK] 2023-11-10 10:52:52,765 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/WALs/jenkins-hbase20.apache.org,43721,1699613570510/jenkins-hbase20.apache.org%2C43721%2C1699613570510.meta.1699613572747.meta 2023-11-10 10:52:52,765 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40667,DS-600d98fc-9b09-469d-8748-7bbfcfb44485,DISK]] 2023-11-10 10:52:52,765 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:52:52,767 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-10 10:52:52,783 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-10 10:52:52,788 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-10 10:52:52,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-10 10:52:52,792 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:52,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-10 10:52:52,793 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-10 10:52:52,796 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-10 10:52:52,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/info 2023-11-10 10:52:52,797 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/info 2023-11-10 10:52:52,798 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-10 10:52:52,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:52,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-10 10:52:52,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/rep_barrier 2023-11-10 10:52:52,800 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/rep_barrier 2023-11-10 10:52:52,801 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-10 10:52:52,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:52,802 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-10 10:52:52,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/table 2023-11-10 10:52:52,804 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/table 2023-11-10 10:52:52,804 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-10 10:52:52,805 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:52,807 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740 2023-11-10 10:52:52,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740 2023-11-10 10:52:52,812 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-10 10:52:52,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-10 10:52:52,816 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74365175, jitterRate=0.10812745988368988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-10 10:52:52,816 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-10 10:52:52,824 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699613572719 2023-11-10 10:52:52,839 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-10 10:52:52,839 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-10 10:52:52,840 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43721,1699613570510, state=OPEN 2023-11-10 10:52:52,844 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-10 10:52:52,844 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-10 10:52:52,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-10 10:52:52,849 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43721,1699613570510 in 305 msec 2023-11-10 10:52:52,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-10 10:52:52,855 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 498 msec 2023-11-10 10:52:52,860 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0810 sec 2023-11-10 10:52:52,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699613572860, completionTime=-1 2023-11-10 10:52:52,860 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-10 10:52:52,860 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-10 10:52:52,917 DEBUG [hconnection-0x3eaa205b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:52:52,920 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:52:52,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-10 10:52:52,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699613632937 2023-11-10 10:52:52,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699613692937 2023-11-10 10:52:52,937 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 76 msec 2023-11-10 10:52:52,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35827,1699613569566-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,969 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35827,1699613569566-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,969 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35827,1699613569566-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:35827, period=300000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,970 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-10 10:52:52,979 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-10 10:52:52,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-10 10:52:52,989 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-10 10:52:52,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-10 10:52:53,002 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:52:53,004 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:52:53,024 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:53,027 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4 empty. 2023-11-10 10:52:53,028 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:53,028 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-10 10:52:53,454 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-10 10:52:53,457 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 018ecef83024ab82c89a197d629ec7a4, NAME => 'hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:52:53,879 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:53,880 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 018ecef83024ab82c89a197d629ec7a4, disabling compactions & flushes 2023-11-10 10:52:53,880 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:53,880 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:53,880 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. after waiting 0 ms 2023-11-10 10:52:53,880 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:53,881 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:53,881 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 018ecef83024ab82c89a197d629ec7a4: 2023-11-10 10:52:53,889 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:52:53,903 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699613573892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613573892"}]},"ts":"1699613573892"} 2023-11-10 10:52:53,923 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:52:53,925 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:52:53,928 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613573925"}]},"ts":"1699613573925"} 2023-11-10 10:52:53,932 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-10 10:52:53,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=018ecef83024ab82c89a197d629ec7a4, ASSIGN}] 2023-11-10 10:52:53,942 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=018ecef83024ab82c89a197d629ec7a4, ASSIGN 2023-11-10 10:52:53,944 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=018ecef83024ab82c89a197d629ec7a4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:52:54,095 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=018ecef83024ab82c89a197d629ec7a4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:54,096 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699613574095"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613574095"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613574095"}]},"ts":"1699613574095"} 2023-11-10 10:52:54,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 018ecef83024ab82c89a197d629ec7a4, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:52:54,261 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:54,272 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:54,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 018ecef83024ab82c89a197d629ec7a4, NAME => 'hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:52:54,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:54,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,274 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,276 INFO [StoreOpener-018ecef83024ab82c89a197d629ec7a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,277 DEBUG [StoreOpener-018ecef83024ab82c89a197d629ec7a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/info 2023-11-10 10:52:54,278 DEBUG [StoreOpener-018ecef83024ab82c89a197d629ec7a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/info 2023-11-10 10:52:54,278 INFO [StoreOpener-018ecef83024ab82c89a197d629ec7a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 018ecef83024ab82c89a197d629ec7a4 columnFamilyName info 2023-11-10 10:52:54,279 INFO [StoreOpener-018ecef83024ab82c89a197d629ec7a4-1] regionserver.HStore(310): Store=018ecef83024ab82c89a197d629ec7a4/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:54,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,281 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,285 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:52:54,289 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:52:54,290 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 018ecef83024ab82c89a197d629ec7a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64487593, jitterRate=-0.03905998170375824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:52:54,290 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 018ecef83024ab82c89a197d629ec7a4: 2023-11-10 10:52:54,292 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4., pid=6, masterSystemTime=1699613574261 2023-11-10 10:52:54,296 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:54,296 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:52:54,298 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=018ecef83024ab82c89a197d629ec7a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:54,298 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699613574297"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613574297"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613574297"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613574297"}]},"ts":"1699613574297"} 2023-11-10 10:52:54,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-10 10:52:54,306 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 018ecef83024ab82c89a197d629ec7a4, server=jenkins-hbase20.apache.org,43721,1699613570510 in 198 msec 2023-11-10 10:52:54,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-10 10:52:54,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=018ecef83024ab82c89a197d629ec7a4, ASSIGN in 368 msec 2023-11-10 10:52:54,311 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:52:54,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613574311"}]},"ts":"1699613574311"} 2023-11-10 10:52:54,316 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-10 10:52:54,319 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:52:54,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3280 sec 2023-11-10 10:52:54,405 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-10 10:52:54,408 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-10 10:52:54,408 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:52:54,448 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-10 10:52:54,466 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-10 10:52:54,471 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-11-10 10:52:54,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-10 10:52:54,493 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-10 10:52:54,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-11-10 10:52:54,510 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-10 10:52:54,512 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-10 10:52:54,513 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.934sec 2023-11-10 10:52:54,515 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-10 10:52:54,517 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-10 10:52:54,518 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-10 10:52:54,519 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35827,1699613569566-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-10 10:52:54,520 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35827,1699613569566-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-10 10:52:54,531 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-10 10:52:54,553 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(139): Connect 0x40c66ea7 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:52:54,559 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@245d4923, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:52:54,571 DEBUG [hconnection-0x94c8fe9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:52:54,583 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:52:54,592 INFO [Listener at localhost/37195] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:52:54,594 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(139): Connect 0x7248ce28 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:52:54,599 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bc344d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:52:54,599 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:52:54,641 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=240, ProcessCount=170, AvailableMemoryMB=9708 2023-11-10 10:52:54,652 DEBUG [Listener at localhost/37195] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:52:54,655 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:52:54,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-10 10:52:54,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:54,671 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:52:54,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:52:54,676 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:54,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-10 10:52:54,677 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a empty. 2023-11-10 10:52:54,679 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:54,679 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-10 10:52:54,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-10 10:52:54,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-10 10:52:55,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-10 10:52:55,098 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-10 10:52:55,101 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => cb199996e4f6b2b47673f68e14b3530a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:52:55,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-10 10:52:55,519 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:55,521 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing cb199996e4f6b2b47673f68e14b3530a, disabling compactions & flushes 2023-11-10 10:52:55,521 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,521 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,521 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. after waiting 0 ms 2023-11-10 10:52:55,521 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,521 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,522 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:52:55,529 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:52:55,532 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613575531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613575531"}]},"ts":"1699613575531"} 2023-11-10 10:52:55,536 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:52:55,538 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:52:55,538 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613575538"}]},"ts":"1699613575538"} 2023-11-10 10:52:55,542 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-10 10:52:55,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, ASSIGN}] 2023-11-10 10:52:55,548 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, ASSIGN 2023-11-10 10:52:55,550 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:52:55,702 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cb199996e4f6b2b47673f68e14b3530a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:55,702 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613575701"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613575701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613575701"}]},"ts":"1699613575701"} 2023-11-10 10:52:55,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cb199996e4f6b2b47673f68e14b3530a, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:52:55,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-10 10:52:55,865 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:55,874 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb199996e4f6b2b47673f68e14b3530a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:52:55,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:52:55,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,880 INFO [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,883 DEBUG [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:52:55,883 DEBUG [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:52:55,887 INFO [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb199996e4f6b2b47673f68e14b3530a columnFamilyName family1 2023-11-10 10:52:55,890 INFO [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] regionserver.HStore(310): Store=cb199996e4f6b2b47673f68e14b3530a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:52:55,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:52:55,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:52:55,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cb199996e4f6b2b47673f68e14b3530a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61692984, jitterRate=-0.08070290088653564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:52:55,902 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:52:55,903 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., pid=11, masterSystemTime=1699613575865 2023-11-10 10:52:55,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:55,907 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cb199996e4f6b2b47673f68e14b3530a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:55,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613575907"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613575907"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613575907"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613575907"}]},"ts":"1699613575907"} 2023-11-10 10:52:55,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-10 10:52:55,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cb199996e4f6b2b47673f68e14b3530a, server=jenkins-hbase20.apache.org,43721,1699613570510 in 202 msec 2023-11-10 10:52:55,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-10 10:52:55,918 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, ASSIGN in 368 msec 2023-11-10 10:52:55,919 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:52:55,920 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613575919"}]},"ts":"1699613575919"} 2023-11-10 10:52:55,922 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-10 10:52:55,925 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:52:55,927 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2580 sec 2023-11-10 10:52:56,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-10 10:52:56,813 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-10 10:52:56,835 DEBUG [hconnection-0x3d343c86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:52:56,837 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:52:56,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:52:56,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,980 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:56,980 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:56,981 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:52:56,981 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:52:56,982 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,982 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,983 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:56,983 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:56,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:56,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:56,984 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:56,984 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:52:56,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:52:56,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,985 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:56,987 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:52:56,987 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:56,988 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:52:56,988 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:52:56,988 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:56,988 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:52:56,989 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:52:56,989 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:52:57,523 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301be0ee41fec745a0bc5033561b1f56ad to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511301be0ee41fec745a0bc5033561b1f56ad 2023-11-10 10:52:57,540 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/b826ad8e705c478cb9159b2c46ed1256 2023-11-10 10:52:57,550 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/b826ad8e705c478cb9159b2c46ed1256 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256 2023-11-10 10:52:57,561 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-10 10:52:57,565 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 575ms, sequenceid=5, compaction requested=false 2023-11-10 10:52:57,566 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:57,569 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:52:57,569 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:57,569 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:52:57,570 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:52:57,570 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,570 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:52:57,570 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:52:57,573 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,573 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:57,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:57,574 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,574 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:52:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:57,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:57,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:57,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:52:57,577 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:52:57,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56c0e430[Count = 0] remaining members to acquire global barrier 2023-11-10 10:52:57,577 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,584 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,584 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:52:57,584 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:52:57,584 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,584 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:52:57,584 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:52:57,591 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:52:57,591 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,591 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:57,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:57,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:57,592 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:52:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:57,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:57,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:52:57,596 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:52:57,597 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:52:57,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:52:57,597 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:52:57,597 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,597 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:52:57,600 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,601 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,601 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:57,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:57,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:57,602 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,604 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:57,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,612 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,613 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:57,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:57,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:52:57,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:57,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:57,615 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:52:57,615 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:52:57,716 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:52:57,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:52:57,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:52:57,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:52:57,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,734 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:57,734 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:57,735 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:52:57,735 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:52:57,735 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,735 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,737 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,737 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:57,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:57,738 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:57,738 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:52:57,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,739 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:52:57,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,739 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:52:57,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:57,739 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:52:57,739 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:57,740 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:52:57,740 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:52:57,740 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:52:57,740 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:57,740 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:52:57,740 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:52:58,167 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dc6400c088c54146a3d1d184b45ae955 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128dc6400c088c54146a3d1d184b45ae955 2023-11-10 10:52:58,306 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:52:58,370 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-10 10:52:58,371 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-10 10:52:58,584 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/edc891c4d5f64325afc97c67277a7900 2023-11-10 10:52:58,595 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/edc891c4d5f64325afc97c67277a7900 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/edc891c4d5f64325afc97c67277a7900 2023-11-10 10:52:58,605 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/edc891c4d5f64325afc97c67277a7900, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:52:58,606 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 866ms, sequenceid=9, compaction requested=false 2023-11-10 10:52:58,606 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:52:58,606 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:58,606 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:52:58,607 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:52:58,607 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,607 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:52:58,607 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:52:58,609 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,609 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:58,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:58,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:52:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:58,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:58,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:58,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:52:58,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@130c026c[Count = 0] remaining members to acquire global barrier 2023-11-10 10:52:58,612 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:52:58,612 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,613 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,613 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:52:58,613 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:52:58,613 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:52:58,613 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,613 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:52:58,615 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:52:58,615 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,615 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:58,615 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:52:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:58,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:52:58,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:52:58,619 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:52:58,619 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:52:58,619 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:52:58,619 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,619 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:52:58,625 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,625 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:58,625 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:58,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:58,626 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:58,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,627 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:58,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:58,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:58,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,634 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:58,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:58,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:52:58,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,635 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:52:58,635 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,635 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,635 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:52:58,635 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:52:58,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:58,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:58,736 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:52:58,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:52:58,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:52:58,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:52:58,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,752 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:58,752 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:58,753 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:52:58,753 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:52:58,754 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,754 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,755 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:58,755 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:58,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:58,755 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:58,755 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:52:58,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:52:58,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,757 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:52:58,757 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:58,757 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:52:58,757 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:58,758 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:52:58,758 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:52:58,758 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:52:58,758 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:58,758 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:52:58,758 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:52:58,788 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512019c1527953a5e4b0d990637cafd74008b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512019c1527953a5e4b0d990637cafd74008b 2023-11-10 10:52:59,200 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/e0cb3a9a4c484e6f8fefdb73460817f2 2023-11-10 10:52:59,209 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/e0cb3a9a4c484e6f8fefdb73460817f2 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/e0cb3a9a4c484e6f8fefdb73460817f2 2023-11-10 10:52:59,217 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/e0cb3a9a4c484e6f8fefdb73460817f2, entries=1, sequenceid=13, filesize=5.0 K 2023-11-10 10:52:59,218 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 460ms, sequenceid=13, compaction requested=true 2023-11-10 10:52:59,218 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:52:59,218 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:59,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:52:59,219 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:52:59,219 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,219 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:52:59,219 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:52:59,221 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:59,221 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:59,222 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,222 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:52:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:59,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:52:59,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b6d0f87[Count = 0] remaining members to acquire global barrier 2023-11-10 10:52:59,224 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:52:59,224 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,225 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,225 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:52:59,225 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:52:59,225 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:52:59,225 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,226 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:52:59,227 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:52:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:59,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:52:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:52:59,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:52:59,234 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:52:59,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:52:59,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:52:59,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,234 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:52:59,241 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,241 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:59,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,241 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:59,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:59,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:59,242 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:59,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,244 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:59,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,250 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:59,251 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:59,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:52:59,251 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:59,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:52:59,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:59,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:59,252 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:52:59,252 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:52:59,353 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:52:59,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:52:59,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:52:59,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:52:59,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,366 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:59,366 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:59,367 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:52:59,367 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:52:59,368 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,368 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,369 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,369 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:59,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:59,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:59,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,370 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,370 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:52:59,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:52:59,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,372 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:52:59,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,372 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:52:59,372 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:59,373 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:52:59,373 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:52:59,373 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:52:59,373 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:59,373 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:52:59,373 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:52:59,411 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f9bc99bed21d401ca5469995e006886a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f9bc99bed21d401ca5469995e006886a 2023-11-10 10:52:59,441 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/c22aa43d3bed46d98523a1df208dd992 2023-11-10 10:52:59,455 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/c22aa43d3bed46d98523a1df208dd992 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/c22aa43d3bed46d98523a1df208dd992 2023-11-10 10:52:59,468 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/c22aa43d3bed46d98523a1df208dd992, entries=1, sequenceid=17, filesize=5.0 K 2023-11-10 10:52:59,470 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 97ms, sequenceid=17, compaction requested=true 2023-11-10 10:52:59,470 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:52:59,470 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:59,470 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:52:59,470 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:52:59,471 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,471 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:52:59,471 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:52:59,473 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,473 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:59,474 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,475 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:52:59,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:59,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:59,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:52:59,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74a8b88d[Count = 0] remaining members to acquire global barrier 2023-11-10 10:52:59,477 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:52:59,477 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,483 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,483 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:52:59,483 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,483 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:52:59,483 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:52:59,483 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:52:59,492 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:52:59,492 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,492 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:59,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:59,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:59,492 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:52:59,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:59,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:59,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:52:59,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:52:59,497 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:52:59,497 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:52:59,497 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:52:59,497 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,498 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:52:59,501 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,502 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:59,502 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:52:59,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:52:59,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:52:59,503 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:52:59,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,505 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:52:59,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:52:59,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:59,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,510 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,510 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:52:59,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:59,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:52:59,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:52:59,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:52:59,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:52:59,511 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:52:59,511 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:52:59,611 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:52:59,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:52:59,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:52:59,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:52:59,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,623 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:52:59,623 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:59,624 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:52:59,624 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:52:59,625 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,625 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,626 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,626 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:52:59,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:52:59,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:52:59,627 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:52:59,627 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:52:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:52:59,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,628 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,628 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:52:59,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:52:59,628 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:52:59,628 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:52:59,628 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:52:59,629 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:52:59,629 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:52:59,629 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:52:59,629 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:52:59,629 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:52:59,696 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-10 10:52:59,696 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-10 10:53:00,055 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285badaf05e360492387a12d9bf38ff32b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285badaf05e360492387a12d9bf38ff32b 2023-11-10 10:53:00,467 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/5f1f9d5b3077413db33d28ffbd6a98bc 2023-11-10 10:53:00,476 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/5f1f9d5b3077413db33d28ffbd6a98bc as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5f1f9d5b3077413db33d28ffbd6a98bc 2023-11-10 10:53:00,488 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5f1f9d5b3077413db33d28ffbd6a98bc, entries=1, sequenceid=21, filesize=5.0 K 2023-11-10 10:53:00,490 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 861ms, sequenceid=21, compaction requested=true 2023-11-10 10:53:00,490 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:00,490 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:00,490 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:00,491 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:00,492 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,492 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:53:00,492 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:53:00,494 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,494 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:00,495 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,495 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:00,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:00,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:00,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:00,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:53:00,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2598234c[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:00,497 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:53:00,497 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,498 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,498 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:53:00,498 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:53:00,498 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:00,499 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,499 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:00,500 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:53:00,500 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,500 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:00,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:00,500 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:53:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:00,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:00,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:00,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:53:00,503 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:53:00,504 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:00,504 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:00,504 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,504 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:00,516 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,516 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,516 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:00,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:00,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:00,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:00,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,519 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:00,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:00,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:00,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:00,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:00,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:53:00,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:00,525 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:00,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:00,526 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:00,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:00,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,527 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:00,627 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:00,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:00,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:00,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:00,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,639 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:00,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:00,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:53:00,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:53:00,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,641 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:00,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:00,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:00,642 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:00,642 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:00,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:00,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:53:00,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:00,643 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:53:00,643 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:00,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:53:00,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:00,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:00,644 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:00,644 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:53:00,644 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:01,073 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318e9e1885bd974584815bf131def36628 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318e9e1885bd974584815bf131def36628 2023-11-10 10:53:01,486 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/5a8a3210b69d46c8985db5c1e4b9cf58 2023-11-10 10:53:01,499 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/5a8a3210b69d46c8985db5c1e4b9cf58 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5a8a3210b69d46c8985db5c1e4b9cf58 2023-11-10 10:53:01,510 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5a8a3210b69d46c8985db5c1e4b9cf58, entries=1, sequenceid=25, filesize=5.0 K 2023-11-10 10:53:01,512 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 868ms, sequenceid=25, compaction requested=true 2023-11-10 10:53:01,512 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:01,512 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:53:01,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:53:01,514 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,514 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:01,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:01,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:53:01,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56f45af1[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:01,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:53:01,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,518 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:53:01,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:53:01,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:01,518 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,518 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:53:01,520 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:01,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:53:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:01,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:01,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:53:01,523 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:53:01,524 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:01,524 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:01,524 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,524 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:01,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:01,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:01,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:01,526 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,527 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,529 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,530 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,530 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,530 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:01,530 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:01,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:01,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:01,530 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:01,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:53:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:01,530 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:01,530 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,531 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,531 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,531 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:01,531 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:01,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:01,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:01,631 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:01,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:01,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:01,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:01,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,649 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:01,649 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:01,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:53:01,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:53:01,651 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,651 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,653 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:01,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:01,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:01,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:01,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:01,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,656 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:53:01,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:01,656 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:53:01,656 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:01,657 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:53:01,657 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:01,657 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:01,657 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:01,657 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:53:01,658 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:02,080 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016710b352ccab4e6d96341324f239b1ae to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016710b352ccab4e6d96341324f239b1ae 2023-11-10 10:53:02,514 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/3995910884e54c4798418051f1c2dab2 2023-11-10 10:53:02,522 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/3995910884e54c4798418051f1c2dab2 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/3995910884e54c4798418051f1c2dab2 2023-11-10 10:53:02,531 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/3995910884e54c4798418051f1c2dab2, entries=1, sequenceid=29, filesize=5.0 K 2023-11-10 10:53:02,533 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 875ms, sequenceid=29, compaction requested=true 2023-11-10 10:53:02,533 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:02,533 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:02,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:02,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:02,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:53:02,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:53:02,536 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,536 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:02,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:02,537 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,537 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:02,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:02,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:53:02,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5566769f[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:02,538 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:53:02,539 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,539 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:53:02,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:53:02,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:02,540 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,540 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:02,541 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:53:02,541 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,541 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:02,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:02,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:02,541 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:53:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:02,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:02,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:02,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:53:02,544 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:53:02,544 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:02,544 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:02,544 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,544 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:02,550 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,550 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:02,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,550 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:02,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:02,551 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:02,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:02,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,557 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,558 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:02,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:02,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:02,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:02,559 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:02,559 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:02,659 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:02,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:02,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:02,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:02,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,671 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:02,671 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:02,671 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:53:02,671 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:53:02,672 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,672 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,673 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:02,673 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:02,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:02,673 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:02,673 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:53:02,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:02,675 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:53:02,675 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:02,675 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:53:02,675 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:02,675 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:02,675 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:02,675 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:53:02,675 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:03,103 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010326688ab2810a479f8c1d609dd8fc7cf0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010326688ab2810a479f8c1d609dd8fc7cf0 2023-11-10 10:53:03,114 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/a134aab21eeb4403a769fcace43d5cfb 2023-11-10 10:53:03,123 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/a134aab21eeb4403a769fcace43d5cfb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/a134aab21eeb4403a769fcace43d5cfb 2023-11-10 10:53:03,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/a134aab21eeb4403a769fcace43d5cfb, entries=1, sequenceid=33, filesize=5.0 K 2023-11-10 10:53:03,133 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 458ms, sequenceid=33, compaction requested=true 2023-11-10 10:53:03,133 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:03,133 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:03,133 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:03,134 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:03,134 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,134 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:53:03,134 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:53:03,135 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,135 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:03,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:03,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:03,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:03,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:03,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:03,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:53:03,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64bbd06e[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:03,138 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:53:03,138 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,138 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,139 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:53:03,139 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:53:03,139 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:03,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:03,140 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:53:03,140 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,140 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:03,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:03,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:03,140 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:53:03,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:03,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:03,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:03,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:03,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:53:03,144 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:53:03,145 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:03,145 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:03,145 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,145 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:03,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:03,147 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:03,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:03,147 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:03,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,148 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:03,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:03,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:03,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:03,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:03,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:53:03,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:03,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:03,151 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:03,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:03,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:03,152 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:03,152 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,152 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:03,152 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,152 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,152 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,252 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:03,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:03,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:03,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:03,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,265 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:03,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:03,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:53:03,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:53:03,266 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,266 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,267 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,267 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:03,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:03,267 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:03,267 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:03,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,268 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,268 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:53:03,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:03,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:53:03,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:03,269 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:53:03,269 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:03,269 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:03,269 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:03,269 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:53:03,269 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:03,700 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078d17a19cae3c4684b847d5b841c712bd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509078d17a19cae3c4684b847d5b841c712bd 2023-11-10 10:53:04,110 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/f3d07f3400f14dc08234e24ba23ed5b1 2023-11-10 10:53:04,119 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/f3d07f3400f14dc08234e24ba23ed5b1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/f3d07f3400f14dc08234e24ba23ed5b1 2023-11-10 10:53:04,129 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/f3d07f3400f14dc08234e24ba23ed5b1, entries=1, sequenceid=37, filesize=5.0 K 2023-11-10 10:53:04,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 862ms, sequenceid=37, compaction requested=true 2023-11-10 10:53:04,131 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:04,131 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:04,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:04,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:04,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,132 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:53:04,132 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:53:04,133 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,133 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:04,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:04,134 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,134 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:04,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:04,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:04,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:04,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:53:04,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@dd1df6[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:04,135 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:53:04,135 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:53:04,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:53:04,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:04,136 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,136 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:04,137 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:53:04,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:04,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:53:04,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:04,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:53:04,141 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:53:04,141 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:04,141 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:04,141 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,141 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:04,150 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,150 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:04,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:04,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:04,152 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:04,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,158 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,158 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:04,159 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-10 10:53:04,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:04,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:04,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:04,160 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:04,160 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:04,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:04,260 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:04,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:04,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:04,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:04,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,274 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:04,274 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:04,274 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-10 10:53:04,275 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-10 10:53:04,275 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,275 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,276 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:04,276 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:04,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:04,277 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,277 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:04,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:04,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,277 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,278 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-10 10:53:04,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,278 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-10 10:53:04,278 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:04,279 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-10 10:53:04,279 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:04,280 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:04,280 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:04,280 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. started... 2023-11-10 10:53:04,280 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing cb199996e4f6b2b47673f68e14b3530a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:04,324 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fa24fea357b7463aa964465a7f333e51 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120fa24fea357b7463aa964465a7f333e51 2023-11-10 10:53:04,736 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/30083a9e23174f00afb9f5dbc653b94f 2023-11-10 10:53:04,747 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/30083a9e23174f00afb9f5dbc653b94f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/30083a9e23174f00afb9f5dbc653b94f 2023-11-10 10:53:04,754 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/30083a9e23174f00afb9f5dbc653b94f, entries=1, sequenceid=41, filesize=5.0 K 2023-11-10 10:53:04,755 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cb199996e4f6b2b47673f68e14b3530a in 475ms, sequenceid=41, compaction requested=true 2023-11-10 10:53:04,756 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:04,756 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:04,756 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:04,756 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:04,756 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,756 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-10 10:53:04,756 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-10 10:53:04,758 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,758 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:04,758 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,758 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:04,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-10 10:53:04,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@740afcce[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:04,760 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-10 10:53:04,760 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,761 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,761 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-10 10:53:04,761 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-10 10:53:04,762 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:04,762 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,762 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:04,763 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,763 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-10 10:53:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,763 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:04,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:04,763 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-10 10:53:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:04,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:04,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-10 10:53:04,767 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-10 10:53:04,768 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:04,768 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:04,768 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,768 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:04,769 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,769 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:04,769 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:04,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:04,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:04,770 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:04,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,771 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,774 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,774 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:04,774 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-10 10:53:04,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:04,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:04,774 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:04,774 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:04,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:04,774 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,775 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:04,775 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:04,775 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,775 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:04,775 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,775 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:04,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:04,875 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:04,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:04,881 DEBUG [Listener at localhost/37195] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-10 10:53:04,883 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-10 10:53:04,885 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:04,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:04,899 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:04,901 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614184901 2023-11-10 10:53:04,901 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:04,903 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:53:04,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-10 10:53:04,908 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:04,909 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x176932ad to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:04,913 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f07d6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:04,918 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,801 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a1e5eceaa6d74b13839a07828dee36e4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103a1e5eceaa6d74b13839a07828dee36e4 2023-11-10 10:53:05,803 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:05,819 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:53:05,821 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:53:05,831 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:53:05,833 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:53:05,865 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c7eed4e02d034398afd3b56462695458 first=Optional[r3] last=Optional[r6] 2023-11-10 10:53:05,877 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c7eed4e02d034398afd3b56462695458}] 2023-11-10 10:53:05,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c7eed4e02d034398afd3b56462695458 for inclusion in cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:05,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-10 10:53:05,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:05,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:05,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c7eed4e02d034398afd3b56462695458 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__atp20pv794oh7r9kq10hg7btsp9d9lcprh98f56r0shomp7sdl91f8j17tfo9hdv/family1/c7eed4e02d034398afd3b56462695458 2023-11-10 10:53:05,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__atp20pv794oh7r9kq10hg7btsp9d9lcprh98f56r0shomp7sdl91f8j17tfo9hdv/family1/c7eed4e02d034398afd3b56462695458 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_ 2023-11-10 10:53:05,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__atp20pv794oh7r9kq10hg7btsp9d9lcprh98f56r0shomp7sdl91f8j17tfo9hdv/family1/c7eed4e02d034398afd3b56462695458 into cb199996e4f6b2b47673f68e14b3530a/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_ - updating store file list. 2023-11-10 10:53:05,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_ into cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:05,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__atp20pv794oh7r9kq10hg7btsp9d9lcprh98f56r0shomp7sdl91f8j17tfo9hdv/family1/c7eed4e02d034398afd3b56462695458 into cb199996e4f6b2b47673f68e14b3530a/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_) 2023-11-10 10:53:05,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__atp20pv794oh7r9kq10hg7btsp9d9lcprh98f56r0shomp7sdl91f8j17tfo9hdv/family1/c7eed4e02d034398afd3b56462695458 2023-11-10 10:53:05,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:53:05,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:53:05,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): cb199996e4f6b2b47673f68e14b3530a/family1 is initiating minor compaction 2023-11-10 10:53:05,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5973d7f7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:05,935 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb199996e4f6b2b47673f68e14b3530a/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:05,936 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/edc891c4d5f64325afc97c67277a7900, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/e0cb3a9a4c484e6f8fefdb73460817f2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/c22aa43d3bed46d98523a1df208dd992, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5f1f9d5b3077413db33d28ffbd6a98bc, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5a8a3210b69d46c8985db5c1e4b9cf58, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/3995910884e54c4798418051f1c2dab2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/a134aab21eeb4403a769fcace43d5cfb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/f3d07f3400f14dc08234e24ba23ed5b1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/30083a9e23174f00afb9f5dbc653b94f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp, totalSize=50.2 K 2023-11-10 10:53:05,937 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting edc891c4d5f64325afc97c67277a7900, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:53:05,937 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting e0cb3a9a4c484e6f8fefdb73460817f2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:53:05,937 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting c22aa43d3bed46d98523a1df208dd992, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 5f1f9d5b3077413db33d28ffbd6a98bc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 5a8a3210b69d46c8985db5c1e4b9cf58, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 3995910884e54c4798418051f1c2dab2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting a134aab21eeb4403a769fcace43d5cfb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting f3d07f3400f14dc08234e24ba23ed5b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 30083a9e23174f00afb9f5dbc653b94f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:53:05,938 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 2c3268c1fa6e43f591304274f0bae676_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:53:05,952 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:05,954 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:05,961 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285badaf05e360492387a12d9bf38ff32b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512285badaf05e360492387a12d9bf38ff32b 2023-11-10 10:53:05,963 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318e9e1885bd974584815bf131def36628 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318e9e1885bd974584815bf131def36628 2023-11-10 10:53:05,965 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016710b352ccab4e6d96341324f239b1ae to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601016710b352ccab4e6d96341324f239b1ae 2023-11-10 10:53:05,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010326688ab2810a479f8c1d609dd8fc7cf0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010326688ab2810a479f8c1d609dd8fc7cf0 2023-11-10 10:53:05,967 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-10 10:53:05,967 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:05,968 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:06,016 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb199996e4f6b2b47673f68e14b3530a#family1#compaction#10 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:06,849 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/254e223f4f5d4be7b8d313087efa7981 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/254e223f4f5d4be7b8d313087efa7981 2023-11-10 10:53:06,865 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in cb199996e4f6b2b47673f68e14b3530a/family1 of cb199996e4f6b2b47673f68e14b3530a into 254e223f4f5d4be7b8d313087efa7981(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:06,865 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:06,867 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699613585933; duration=0sec 2023-11-10 10:53:06,868 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:06,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/edc891c4d5f64325afc97c67277a7900, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/e0cb3a9a4c484e6f8fefdb73460817f2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/c22aa43d3bed46d98523a1df208dd992, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5f1f9d5b3077413db33d28ffbd6a98bc, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5a8a3210b69d46c8985db5c1e4b9cf58, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/3995910884e54c4798418051f1c2dab2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/a134aab21eeb4403a769fcace43d5cfb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/f3d07f3400f14dc08234e24ba23ed5b1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/30083a9e23174f00afb9f5dbc653b94f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_] to archive 2023-11-10 10:53:06,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:06,889 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e42a6d63c5fe4efc8f688881429c4450 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205e42a6d63c5fe4efc8f688881429c4450 2023-11-10 10:53:06,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/edc891c4d5f64325afc97c67277a7900 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/edc891c4d5f64325afc97c67277a7900 2023-11-10 10:53:06,891 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:06,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/e0cb3a9a4c484e6f8fefdb73460817f2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/e0cb3a9a4c484e6f8fefdb73460817f2 2023-11-10 10:53:06,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/c22aa43d3bed46d98523a1df208dd992 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/c22aa43d3bed46d98523a1df208dd992 2023-11-10 10:53:06,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5f1f9d5b3077413db33d28ffbd6a98bc to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5f1f9d5b3077413db33d28ffbd6a98bc 2023-11-10 10:53:06,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5a8a3210b69d46c8985db5c1e4b9cf58 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/5a8a3210b69d46c8985db5c1e4b9cf58 2023-11-10 10:53:06,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/3995910884e54c4798418051f1c2dab2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/3995910884e54c4798418051f1c2dab2 2023-11-10 10:53:06,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/a134aab21eeb4403a769fcace43d5cfb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/a134aab21eeb4403a769fcace43d5cfb 2023-11-10 10:53:06,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/f3d07f3400f14dc08234e24ba23ed5b1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/f3d07f3400f14dc08234e24ba23ed5b1 2023-11-10 10:53:06,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/30083a9e23174f00afb9f5dbc653b94f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/30083a9e23174f00afb9f5dbc653b94f 2023-11-10 10:53:06,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/2c3268c1fa6e43f591304274f0bae676_SeqId_44_ 2023-11-10 10:53:06,938 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d99465f894b044038f9f28e43351c678 first=Optional[r00] last=Optional[r2] 2023-11-10 10:53:06,939 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d99465f894b044038f9f28e43351c678}] 2023-11-10 10:53:06,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d99465f894b044038f9f28e43351c678 for inclusion in cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:06,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-10 10:53:06,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:06,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:06,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d99465f894b044038f9f28e43351c678 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fc4blg81rai8n1ut5hgad3u7124ju7f9thesreftum957k8ojcu1lgf4sut9fmr/family1/d99465f894b044038f9f28e43351c678 2023-11-10 10:53:06,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fc4blg81rai8n1ut5hgad3u7124ju7f9thesreftum957k8ojcu1lgf4sut9fmr/family1/d99465f894b044038f9f28e43351c678 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_ 2023-11-10 10:53:06,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fc4blg81rai8n1ut5hgad3u7124ju7f9thesreftum957k8ojcu1lgf4sut9fmr/family1/d99465f894b044038f9f28e43351c678 into cb199996e4f6b2b47673f68e14b3530a/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_ - updating store file list. 2023-11-10 10:53:06,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_ into cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:06,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fc4blg81rai8n1ut5hgad3u7124ju7f9thesreftum957k8ojcu1lgf4sut9fmr/family1/d99465f894b044038f9f28e43351c678 into cb199996e4f6b2b47673f68e14b3530a/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_) 2023-11-10 10:53:06,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fc4blg81rai8n1ut5hgad3u7124ju7f9thesreftum957k8ojcu1lgf4sut9fmr/family1/d99465f894b044038f9f28e43351c678 2023-11-10 10:53:06,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:53:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:53:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): cb199996e4f6b2b47673f68e14b3530a/family1 is initiating minor compaction (all files) 2023-11-10 10:53:06,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@31c9af21; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:06,970 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of cb199996e4f6b2b47673f68e14b3530a/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:06,970 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/254e223f4f5d4be7b8d313087efa7981, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp, totalSize=358.6 K 2023-11-10 10:53:06,971 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting b826ad8e705c478cb9159b2c46ed1256, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:53:06,972 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 254e223f4f5d4be7b8d313087efa7981, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:53:06,973 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878854600 2023-11-10 10:53:06,973 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:06,975 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:06,977 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511301be0ee41fec745a0bc5033561b1f56ad to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511301be0ee41fec745a0bc5033561b1f56ad 2023-11-10 10:53:06,979 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512019c1527953a5e4b0d990637cafd74008b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512019c1527953a5e4b0d990637cafd74008b 2023-11-10 10:53:06,980 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f9bc99bed21d401ca5469995e006886a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f9bc99bed21d401ca5469995e006886a 2023-11-10 10:53:06,980 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-10 10:53:06,980 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-10 10:53:06,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:06,981 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:06,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:06,984 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:06,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0950 sec 2023-11-10 10:53:07,025 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): cb199996e4f6b2b47673f68e14b3530a#family1#compaction#11 average throughput is 4.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:07,070 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/.tmp/family1/905c503c43534b3c8c63fd6059771fb8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/905c503c43534b3c8c63fd6059771fb8 2023-11-10 10:53:07,084 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2696): Can't archive compacted file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256 because of either isCompactedAway=true or file has reference, isReferencedInReads=true, refCount=1, skipping for now. 2023-11-10 10:53:07,084 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cb199996e4f6b2b47673f68e14b3530a/family1 of cb199996e4f6b2b47673f68e14b3530a into 905c503c43534b3c8c63fd6059771fb8(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:07,084 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:07,086 INFO [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2696): Can't archive compacted file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_ because of either isCompactedAway=true or file has reference, isReferencedInReads=true, refCount=1, skipping for now. 2023-11-10 10:53:07,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/254e223f4f5d4be7b8d313087efa7981] to archive 2023-11-10 10:53:07,086 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1699613586969; duration=0sec 2023-11-10 10:53:07,086 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:07,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:07,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/254e223f4f5d4be7b8d313087efa7981 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/254e223f4f5d4be7b8d313087efa7981 2023-11-10 10:53:07,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_] to archive 2023-11-10 10:53:07,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:07,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/b826ad8e705c478cb9159b2c46ed1256 2023-11-10 10:53:07,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/6e03ba94dc8d4d7ca9df8657648dc7b8_SeqId_47_ 2023-11-10 10:53:07,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-10 10:53:07,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:07,250 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-10 10:53:07,252 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-10 10:53:07,252 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-10 10:53:07,257 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-10 10:53:07,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, REOPEN/MOVE}] 2023-11-10 10:53:07,275 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, REOPEN/MOVE 2023-11-10 10:53:07,276 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cb199996e4f6b2b47673f68e14b3530a, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:07,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613587276"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613587276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613587276"}]},"ts":"1699613587276"} 2023-11-10 10:53:07,280 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure cb199996e4f6b2b47673f68e14b3530a, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:07,439 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:07,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cb199996e4f6b2b47673f68e14b3530a, disabling compactions & flushes 2023-11-10 10:53:07,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. after waiting 0 ms 2023-11-10 10:53:07,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-10 10:53:07,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:07,456 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: cb199996e4f6b2b47673f68e14b3530a to self. 2023-11-10 10:53:07,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,459 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cb199996e4f6b2b47673f68e14b3530a, regionState=CLOSED 2023-11-10 10:53:07,459 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613587458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613587458"}]},"ts":"1699613587458"} 2023-11-10 10:53:07,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-10 10:53:07,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure cb199996e4f6b2b47673f68e14b3530a, server=jenkins-hbase20.apache.org,43721,1699613570510 in 181 msec 2023-11-10 10:53:07,464 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=true 2023-11-10 10:53:07,615 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cb199996e4f6b2b47673f68e14b3530a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:07,615 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613587615"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613587615"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613587615"}]},"ts":"1699613587615"} 2023-11-10 10:53:07,618 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure cb199996e4f6b2b47673f68e14b3530a, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:07,772 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:07,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb199996e4f6b2b47673f68e14b3530a, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:53:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,778 INFO [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,779 DEBUG [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:07,779 DEBUG [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:07,780 INFO [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb199996e4f6b2b47673f68e14b3530a columnFamilyName family1 2023-11-10 10:53:07,788 DEBUG [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/905c503c43534b3c8c63fd6059771fb8 2023-11-10 10:53:07,789 INFO [StoreOpener-cb199996e4f6b2b47673f68e14b3530a-1] regionserver.HStore(310): Store=cb199996e4f6b2b47673f68e14b3530a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:07,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:53:07,797 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened cb199996e4f6b2b47673f68e14b3530a; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61230700, jitterRate=-0.08759146928787231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:53:07,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:07,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., pid=17, masterSystemTime=1699613587772 2023-11-10 10:53:07,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:53:07,801 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=cb199996e4f6b2b47673f68e14b3530a, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:07,801 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699613587801"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613587801"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613587801"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613587801"}]},"ts":"1699613587801"} 2023-11-10 10:53:07,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-10 10:53:07,805 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure cb199996e4f6b2b47673f68e14b3530a, server=jenkins-hbase20.apache.org,43721,1699613570510 in 185 msec 2023-11-10 10:53:07,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-10 10:53:07,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=cb199996e4f6b2b47673f68e14b3530a, REOPEN/MOVE in 532 msec 2023-11-10 10:53:07,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-10 10:53:07,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 553 msec 2023-11-10 10:53:07,813 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 605 msec 2023-11-10 10:53:07,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-10 10:53:07,821 INFO [Listener at localhost/37195] compactions.TestMobCompactor(278): alter status finished 2023-11-10 10:53:07,823 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-10 10:53:07,824 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:07,825 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:07,826 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614187826 2023-11-10 10:53:07,826 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:07,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:53:07,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-10 10:53:07,828 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:07,830 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x132a6594 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:07,834 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c7007a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:07,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:07,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:07,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:07,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:07,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:08,272 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112835c47b5bd2bc45cab990355470a3047e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112835c47b5bd2bc45cab990355470a3047e 2023-11-10 10:53:08,273 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:08,287 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:53:08,288 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:53:08,297 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:53:08,300 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:53:08,320 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/067632c616f44229bf4fc38f0cea4352 first=Optional[r05] last=Optional[r8] 2023-11-10 10:53:08,320 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/067632c616f44229bf4fc38f0cea4352}] 2023-11-10 10:53:08,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/067632c616f44229bf4fc38f0cea4352 for inclusion in cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:08,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-10 10:53:08,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:08,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:53:08,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/067632c616f44229bf4fc38f0cea4352 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__do4o2bvblpqocn2puhdekit122jpolk4grvi3f50d4ph6bi91qm9s35hpcisum09/family1/067632c616f44229bf4fc38f0cea4352 2023-11-10 10:53:08,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__do4o2bvblpqocn2puhdekit122jpolk4grvi3f50d4ph6bi91qm9s35hpcisum09/family1/067632c616f44229bf4fc38f0cea4352 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/7c9a1c1c73b648db8dc6c65578a9ea1e_SeqId_53_ 2023-11-10 10:53:08,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__do4o2bvblpqocn2puhdekit122jpolk4grvi3f50d4ph6bi91qm9s35hpcisum09/family1/067632c616f44229bf4fc38f0cea4352 into cb199996e4f6b2b47673f68e14b3530a/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/7c9a1c1c73b648db8dc6c65578a9ea1e_SeqId_53_ - updating store file list. 2023-11-10 10:53:08,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/7c9a1c1c73b648db8dc6c65578a9ea1e_SeqId_53_ into cb199996e4f6b2b47673f68e14b3530a/family1 2023-11-10 10:53:08,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__do4o2bvblpqocn2puhdekit122jpolk4grvi3f50d4ph6bi91qm9s35hpcisum09/family1/067632c616f44229bf4fc38f0cea4352 into cb199996e4f6b2b47673f68e14b3530a/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/family1/7c9a1c1c73b648db8dc6c65578a9ea1e_SeqId_53_) 2023-11-10 10:53:08,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__do4o2bvblpqocn2puhdekit122jpolk4grvi3f50d4ph6bi91qm9s35hpcisum09/family1/067632c616f44229bf4fc38f0cea4352 2023-11-10 10:53:08,352 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:08,353 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:08,356 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120fa24fea357b7463aa964465a7f333e51 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120fa24fea357b7463aa964465a7f333e51 2023-11-10 10:53:08,359 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128dc6400c088c54146a3d1d184b45ae955 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128dc6400c088c54146a3d1d184b45ae955 2023-11-10 10:53:08,359 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-10 10:53:08,359 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-10 10:53:08,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:08,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:08,360 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-10 10:53:08,360 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-10 10:53:08,360 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:08,362 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:08,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 539 msec 2023-11-10 10:53:08,464 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=253 (was 214) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41296 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x176932ad-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41262 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41206 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3974e2cf-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x46c75a92-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41430 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41400 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x176932ad-SendThread(127.0.0.1:62972) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RS:0;jenkins-hbase20:43721-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x176932ad sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/624005578.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x132a6594-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41314 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41500 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3974e2cf-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41232 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41374 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41490 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x46c75a92-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x132a6594-SendThread(127.0.0.1:62972) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41438 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41290 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3974e2cf-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x46c75a92-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x132a6594 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/624005578.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3974e2cf-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41416 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3974e2cf-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41358 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:41326 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_17143165_17 at /127.0.0.1:41396 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=623 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 240) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 170), AvailableMemoryMB=8945 (was 9708) 2023-11-10 10:53:08,483 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=253, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=169, AvailableMemoryMB=8944 2023-11-10 10:53:08,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-10 10:53:08,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:08,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:53:08,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-10 10:53:08,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:53:08,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-10 10:53:08,492 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:08,493 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04 empty. 2023-11-10 10:53:08,493 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:08,494 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-10 10:53:08,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-10 10:53:08,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-10 10:53:08,903 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-10 10:53:08,905 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4eef889b597ecf2d30eb14d14197ee04, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:09,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-10 10:53:09,312 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:09,312 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 4eef889b597ecf2d30eb14d14197ee04, disabling compactions & flushes 2023-11-10 10:53:09,312 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,312 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,312 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. after waiting 0 ms 2023-11-10 10:53:09,312 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,312 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,312 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:09,315 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:53:09,316 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699613589316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613589316"}]},"ts":"1699613589316"} 2023-11-10 10:53:09,319 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:53:09,320 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:53:09,320 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613589320"}]},"ts":"1699613589320"} 2023-11-10 10:53:09,322 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-10 10:53:09,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4eef889b597ecf2d30eb14d14197ee04, ASSIGN}] 2023-11-10 10:53:09,329 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4eef889b597ecf2d30eb14d14197ee04, ASSIGN 2023-11-10 10:53:09,330 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4eef889b597ecf2d30eb14d14197ee04, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:09,481 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4eef889b597ecf2d30eb14d14197ee04, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:09,481 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699613589481"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613589481"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613589481"}]},"ts":"1699613589481"} 2023-11-10 10:53:09,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 4eef889b597ecf2d30eb14d14197ee04, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-10 10:53:09,637 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:09,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4eef889b597ecf2d30eb14d14197ee04, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:53:09,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:09,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,646 INFO [StoreOpener-4eef889b597ecf2d30eb14d14197ee04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,649 DEBUG [StoreOpener-4eef889b597ecf2d30eb14d14197ee04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:09,649 DEBUG [StoreOpener-4eef889b597ecf2d30eb14d14197ee04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:09,649 INFO [StoreOpener-4eef889b597ecf2d30eb14d14197ee04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4eef889b597ecf2d30eb14d14197ee04 columnFamilyName family1 2023-11-10 10:53:09,651 INFO [StoreOpener-4eef889b597ecf2d30eb14d14197ee04-1] regionserver.HStore(310): Store=4eef889b597ecf2d30eb14d14197ee04/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:09,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:53:09,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:09,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4eef889b597ecf2d30eb14d14197ee04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66498429, jitterRate=-0.009096190333366394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:53:09,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:09,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04., pid=21, masterSystemTime=1699613589637 2023-11-10 10:53:09,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:09,661 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=4eef889b597ecf2d30eb14d14197ee04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:09,661 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699613589661"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613589661"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613589661"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613589661"}]},"ts":"1699613589661"} 2023-11-10 10:53:09,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-10 10:53:09,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 4eef889b597ecf2d30eb14d14197ee04, server=jenkins-hbase20.apache.org,43721,1699613570510 in 179 msec 2023-11-10 10:53:09,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-10 10:53:09,667 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=4eef889b597ecf2d30eb14d14197ee04, ASSIGN in 340 msec 2023-11-10 10:53:09,668 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:53:09,668 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613589668"}]},"ts":"1699613589668"} 2023-11-10 10:53:09,669 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-10 10:53:09,671 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:53:09,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1850 sec 2023-11-10 10:53:10,373 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:10,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-10 10:53:10,601 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-10 10:53:10,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:10,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,647 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:10,647 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:10,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:10,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:10,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,649 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,650 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:10,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:10,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:10,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:10,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:10,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:10,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,651 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:10,651 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:10,651 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:10,652 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:10,652 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:10,652 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:10,652 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:10,652 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:10,652 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:53:11,086 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130af7852072b4f46db87647f7e961a1da5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130af7852072b4f46db87647f7e961a1da5 2023-11-10 10:53:11,492 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/ec6d5ebae99b4feb96b5eee028c1eca8 2023-11-10 10:53:11,499 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/ec6d5ebae99b4feb96b5eee028c1eca8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/ec6d5ebae99b4feb96b5eee028c1eca8 2023-11-10 10:53:11,507 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/ec6d5ebae99b4feb96b5eee028c1eca8, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-10 10:53:11,508 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 856ms, sequenceid=5, compaction requested=false 2023-11-10 10:53:11,508 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:11,508 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:11,508 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:11,509 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:11,509 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,509 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:11,509 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:11,511 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:11,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:11,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:11,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@123eae5e[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:11,514 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:11,514 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,515 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:11,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:11,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:11,515 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:11,517 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,517 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,517 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:11,517 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:11,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:11,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:11,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:11,521 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:11,521 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:11,521 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:11,521 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,521 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:11,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:11,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:11,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:11,524 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:11,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:11,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:11,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,528 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:11,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:11,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,534 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:11,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:11,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:11,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:11,535 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:11,535 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:11,535 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:11,635 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:11,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:11,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:11,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:11,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,647 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:11,647 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:11,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:11,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:11,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,649 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,650 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:11,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:11,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:11,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:11,650 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,652 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,652 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:11,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:11,652 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:11,653 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:11,653 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:11,653 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:11,653 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:11,653 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:11,653 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:11,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:53:12,074 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281a515bf0795542d8bd13e7b90454733c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281a515bf0795542d8bd13e7b90454733c 2023-11-10 10:53:12,482 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/9694c1f00f684c83b83f6e9562f92f7e 2023-11-10 10:53:12,500 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/9694c1f00f684c83b83f6e9562f92f7e as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/9694c1f00f684c83b83f6e9562f92f7e 2023-11-10 10:53:12,509 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/9694c1f00f684c83b83f6e9562f92f7e, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:53:12,510 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 856ms, sequenceid=9, compaction requested=false 2023-11-10 10:53:12,510 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:12,510 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:12,510 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:12,510 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:12,510 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,510 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:12,510 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:12,512 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:12,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:12,512 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:12,513 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,513 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:12,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:12,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:12,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28bc24d7[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:12,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:12,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,525 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:12,525 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:12,525 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:12,525 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,525 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:12,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:12,533 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:12,533 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:12,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:12,537 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:12,537 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:12,537 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:12,537 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:12,537 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,537 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:12,541 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,541 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,542 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:12,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:12,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:12,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,550 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,555 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:12,555 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:12,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:12,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:12,556 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,556 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,556 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,556 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,556 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,556 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:12,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:12,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:12,556 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:12,557 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:12,557 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:12,557 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:12,657 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:12,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:12,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:12,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:12,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,668 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:12,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:12,669 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:12,669 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:12,670 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,670 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,671 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,671 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:12,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:12,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:12,673 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:12,673 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:12,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:12,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,674 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,682 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:12,682 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:12,682 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:12,682 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:12,683 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:12,684 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:12,684 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:12,684 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:12,684 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:12,684 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:13,003 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:53:13,112 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012094e90853c740738d905875dd88f331 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012094e90853c740738d905875dd88f331 2023-11-10 10:53:13,522 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/79873329d0264379bbb6d3449155208d 2023-11-10 10:53:13,531 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/79873329d0264379bbb6d3449155208d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/79873329d0264379bbb6d3449155208d 2023-11-10 10:53:13,538 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/79873329d0264379bbb6d3449155208d, entries=1, sequenceid=13, filesize=4.9 K 2023-11-10 10:53:13,539 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 855ms, sequenceid=13, compaction requested=true 2023-11-10 10:53:13,540 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:13,540 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:13,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:13,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:13,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:13,540 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:13,541 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,541 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:13,542 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,542 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:13,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:13,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:13,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40e6be9b[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:13,543 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:13,543 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,544 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:13,544 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:13,545 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,545 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:13,546 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:13,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:13,546 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:13,546 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:13,546 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:13,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:13,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:13,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:13,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:13,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:13,552 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:13,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:13,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:13,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,552 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:13,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:13,558 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:13,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:13,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:13,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,560 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:13,561 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,566 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,566 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:13,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,567 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:13,567 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,567 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:13,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:13,569 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:13,569 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:13,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:13,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:13,669 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:13,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:13,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:13,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:13,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,688 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:13,688 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:13,688 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:13,689 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:13,689 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,689 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,690 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,690 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:13,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:13,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:13,691 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:13,691 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:13,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:13,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,691 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,692 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:13,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:13,692 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:13,692 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:13,692 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:13,693 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:13,693 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:13,693 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:13,693 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:13,693 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:13,714 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205507fe67389694dd4bc42aba2dd23d36d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205507fe67389694dd4bc42aba2dd23d36d 2023-11-10 10:53:14,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/640c84f4351b44d5afac2990ce3fdebb 2023-11-10 10:53:14,142 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/640c84f4351b44d5afac2990ce3fdebb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/640c84f4351b44d5afac2990ce3fdebb 2023-11-10 10:53:14,147 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/640c84f4351b44d5afac2990ce3fdebb, entries=1, sequenceid=17, filesize=4.9 K 2023-11-10 10:53:14,148 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 455ms, sequenceid=17, compaction requested=true 2023-11-10 10:53:14,148 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:14,148 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:14,148 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:14,148 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:14,148 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,148 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:14,149 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:14,150 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,150 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:14,150 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:14,150 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:14,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:14,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:14,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6329d6c5[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:14,152 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:14,152 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,152 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,153 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:14,153 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:14,153 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:14,153 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,153 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:14,155 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:14,155 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,155 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:14,155 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:14,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:14,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:14,158 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:14,158 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:14,158 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:14,158 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,158 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:14,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,160 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:14,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,160 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:14,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:14,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:14,160 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,163 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,167 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:14,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:14,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:14,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:14,168 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:14,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:14,168 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:14,168 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:14,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:14,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:14,269 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:14,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:14,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:14,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:14,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,279 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:14,279 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:14,279 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:14,280 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:14,280 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,280 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,282 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:14,282 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:14,282 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:14,282 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:14,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:14,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,283 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:14,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:14,284 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:14,284 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:14,284 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:14,285 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:14,285 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:14,285 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:14,285 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:14,285 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:14,701 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228601c1721a6004fef924c6f142d9e55fb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228601c1721a6004fef924c6f142d9e55fb 2023-11-10 10:53:15,108 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/dc0d8c5628e045088aa45d4e0ec59d29 2023-11-10 10:53:15,115 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/dc0d8c5628e045088aa45d4e0ec59d29 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/dc0d8c5628e045088aa45d4e0ec59d29 2023-11-10 10:53:15,121 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/dc0d8c5628e045088aa45d4e0ec59d29, entries=1, sequenceid=21, filesize=4.9 K 2023-11-10 10:53:15,122 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 837ms, sequenceid=21, compaction requested=true 2023-11-10 10:53:15,123 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:15,123 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:15,123 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:15,123 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:15,123 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,123 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:15,123 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:15,124 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,124 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:15,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:15,125 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:15,125 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:15,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:15,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@402c8a0[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:15,126 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:15,126 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,127 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:15,127 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:15,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:15,128 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:15,128 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,128 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:15,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:15,128 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:15,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:15,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:15,131 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:15,131 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:15,131 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:15,131 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,131 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:15,132 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,132 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:15,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,133 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:15,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:15,133 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,134 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:15,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:15,136 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:15,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:15,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:15,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:15,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:15,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,137 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,137 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,137 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,137 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:15,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:15,137 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:15,137 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:15,238 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:15,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:15,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:15,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:15,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,249 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:15,249 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:15,250 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:15,250 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:15,251 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,251 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,253 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,253 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:15,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:15,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:15,254 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:15,254 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:15,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:15,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,255 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,255 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:15,255 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:15,255 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:15,256 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:15,256 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:15,256 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:15,256 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:15,256 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:15,256 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:15,256 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:15,672 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512317716cf3233fd4c05b718de9906f7746e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317716cf3233fd4c05b718de9906f7746e 2023-11-10 10:53:16,079 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/02c78c67149e451e9eb9bed06ac99367 2023-11-10 10:53:16,088 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/02c78c67149e451e9eb9bed06ac99367 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/02c78c67149e451e9eb9bed06ac99367 2023-11-10 10:53:16,097 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/02c78c67149e451e9eb9bed06ac99367, entries=1, sequenceid=25, filesize=4.9 K 2023-11-10 10:53:16,098 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 842ms, sequenceid=25, compaction requested=true 2023-11-10 10:53:16,098 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:16,098 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:16,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:16,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:16,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:16,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:16,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,100 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:16,101 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,101 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:16,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:16,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:16,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:16,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d51ce6b[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:16,105 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:16,105 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,106 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,107 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:16,107 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:16,107 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:16,108 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,108 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:16,109 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,109 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:16,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:16,109 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:16,109 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:16,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:16,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:16,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:16,113 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:16,113 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:16,113 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:16,113 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,113 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:16,116 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,116 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,116 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:16,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:16,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:16,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:16,118 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,120 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:16,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,133 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:16,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-10 10:53:16,133 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:16,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-10 10:53:16,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:16,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:16,133 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:16,134 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:16,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:16,235 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:16,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:16,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:16,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,244 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:16,245 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:16,245 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:16,245 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:16,246 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,246 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,249 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,249 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:16,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:16,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:16,250 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:16,250 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:16,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:16,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,251 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,251 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:16,251 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:16,251 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:16,251 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:16,252 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:16,254 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:16,254 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:16,254 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:16,254 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:16,254 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:16,679 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012bfbd731dd5443378dce41976fe7a6fd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601012bfbd731dd5443378dce41976fe7a6fd 2023-11-10 10:53:17,087 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/27c6c0e40bf44a9c917bf3e2e13289fb 2023-11-10 10:53:17,097 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/27c6c0e40bf44a9c917bf3e2e13289fb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/27c6c0e40bf44a9c917bf3e2e13289fb 2023-11-10 10:53:17,103 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/27c6c0e40bf44a9c917bf3e2e13289fb, entries=1, sequenceid=29, filesize=4.9 K 2023-11-10 10:53:17,104 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 850ms, sequenceid=29, compaction requested=true 2023-11-10 10:53:17,104 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:17,104 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:17,104 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:17,104 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:17,104 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,104 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:17,104 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:17,106 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,106 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:17,107 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,107 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:17,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:17,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:17,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3836a33c[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:17,108 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:17,108 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,109 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,109 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:17,109 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:17,109 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:17,109 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,110 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:17,110 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:17,110 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,110 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:17,111 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:17,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:17,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:17,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:17,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:17,114 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:17,114 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:17,114 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:17,114 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,114 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:17,115 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,115 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:17,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,116 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:17,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:17,116 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,117 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,119 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,119 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,119 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:17,119 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,119 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:17,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:17,119 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:17,119 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:17,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:17,120 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,120 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,120 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,120 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:17,120 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:17,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:17,221 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:17,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:17,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,231 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:17,231 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:17,232 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:17,232 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:17,232 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,233 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,233 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:17,233 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:17,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:17,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:17,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,235 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,235 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:17,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:17,238 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:17,238 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:17,239 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:17,240 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:17,240 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:17,240 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:17,240 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:17,241 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:17,666 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033caa7ca24ce347a1bd6b963af3c8e8fe to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033caa7ca24ce347a1bd6b963af3c8e8fe 2023-11-10 10:53:18,074 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/90de86705bf548288f89ba8c7b070595 2023-11-10 10:53:18,083 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/90de86705bf548288f89ba8c7b070595 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/90de86705bf548288f89ba8c7b070595 2023-11-10 10:53:18,090 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/90de86705bf548288f89ba8c7b070595, entries=1, sequenceid=33, filesize=4.9 K 2023-11-10 10:53:18,091 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 850ms, sequenceid=33, compaction requested=true 2023-11-10 10:53:18,091 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:18,091 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:18,091 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:18,091 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:18,092 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,092 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:18,092 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:18,093 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,093 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:18,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:18,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:18,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:18,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:18,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:18,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:18,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1584d501[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:18,096 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:18,096 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,097 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,098 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:18,098 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:18,098 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:18,098 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,098 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:18,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:18,099 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:18,099 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:18,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:18,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:18,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:18,102 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:18,102 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:18,102 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:18,102 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,102 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:18,103 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,103 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:18,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,104 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:18,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:18,104 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,105 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:18,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:18,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:18,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:18,107 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:18,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:18,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:18,108 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,108 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,108 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,108 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:18,108 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:18,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:18,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:18,208 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:18,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:18,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:18,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:18,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,220 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:18,220 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:18,221 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:18,221 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:18,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,223 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:18,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:18,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:18,224 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:18,224 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:18,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,226 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,226 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:18,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:18,226 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:18,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:18,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:18,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:18,227 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:18,227 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:18,227 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:18,227 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:18,642 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079d191f241af44e8e978d4b24dd52e490 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509079d191f241af44e8e978d4b24dd52e490 2023-11-10 10:53:19,050 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/4c556d4ce9894aa29bbcada321d3dee8 2023-11-10 10:53:19,061 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/4c556d4ce9894aa29bbcada321d3dee8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4c556d4ce9894aa29bbcada321d3dee8 2023-11-10 10:53:19,069 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4c556d4ce9894aa29bbcada321d3dee8, entries=1, sequenceid=37, filesize=4.9 K 2023-11-10 10:53:19,070 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 843ms, sequenceid=37, compaction requested=true 2023-11-10 10:53:19,070 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:19,070 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:19,070 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:19,070 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:19,070 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,070 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:19,070 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:19,072 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:19,072 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:19,073 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,073 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:19,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:19,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:19,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:19,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d148d9[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:19,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:19,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,075 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,075 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:19,075 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:19,075 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:19,075 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,075 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:19,076 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,076 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:19,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:19,076 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:19,076 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:19,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:19,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:19,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:19,079 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:19,079 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:19,079 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:19,079 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,079 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:19,081 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,081 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:19,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,081 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:19,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:19,081 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:19,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:19,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,083 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:19,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,085 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,086 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:19,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:19,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:19,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:19,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:19,086 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:19,087 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:19,087 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:19,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:19,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:19,187 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:19,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:19,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:19,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:19,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,200 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:19,200 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:19,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:53:19,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:19,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:19,203 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:19,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:19,204 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:19,204 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:19,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:19,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,206 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,207 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:53:19,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:19,207 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:53:19,207 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:19,208 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:53:19,208 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:19,208 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:19,208 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:19,208 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. started... 2023-11-10 10:53:19,208 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4eef889b597ecf2d30eb14d14197ee04 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:19,628 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e11094b48a9145e589da60755acf1325 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e11094b48a9145e589da60755acf1325 2023-11-10 10:53:20,036 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/6ecf5e8eefb54b5abe3e03cbfb413130 2023-11-10 10:53:20,046 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/6ecf5e8eefb54b5abe3e03cbfb413130 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/6ecf5e8eefb54b5abe3e03cbfb413130 2023-11-10 10:53:20,055 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/6ecf5e8eefb54b5abe3e03cbfb413130, entries=1, sequenceid=41, filesize=4.9 K 2023-11-10 10:53:20,056 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4eef889b597ecf2d30eb14d14197ee04 in 848ms, sequenceid=41, compaction requested=true 2023-11-10 10:53:20,056 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:20,056 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:20,056 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:20,056 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:20,056 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,056 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:53:20,056 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:53:20,058 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,058 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:20,058 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:20,058 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:20,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:53:20,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44b0ecde[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:20,060 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:20,060 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,061 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:20,061 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:53:20,061 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:20,061 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,061 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:20,062 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,062 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:53:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:20,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:20,062 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:20,062 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:53:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:20,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:20,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:20,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:20,065 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:53:20,065 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:20,065 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:20,065 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,065 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:20,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:20,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:20,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:20,075 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,076 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:20,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:20,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:20,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-10 10:53:20,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:20,082 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:20,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:20,083 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,084 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,084 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:20,085 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:20,084 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:20,185 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:20,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:20,188 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-10 10:53:20,190 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:20,191 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:20,192 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614200192 2023-11-10 10:53:20,192 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:20,193 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:53:20,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-10 10:53:20,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:20,197 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x3f9305d0 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:20,202 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@739278b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:20,202 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:21,041 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fce5516e884a499c8eb699209ca68e2a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103fce5516e884a499c8eb699209ca68e2a 2023-11-10 10:53:21,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:21,059 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:53:21,060 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:53:21,068 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:53:21,069 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:53:21,081 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ad68f7b706f64e2793ca7bcea386e024 first=Optional[r5] last=Optional[r6] 2023-11-10 10:53:21,082 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ad68f7b706f64e2793ca7bcea386e024}] 2023-11-10 10:53:21,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ad68f7b706f64e2793ca7bcea386e024 for inclusion in 4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:21,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-10 10:53:21,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:21,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:21,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ad68f7b706f64e2793ca7bcea386e024 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o5cahscnc4eaf0hdd8ud8d1l2slf4bs7u8eu9oucd5e4hhr2t2t3vcif6fr0mrdv/family1/ad68f7b706f64e2793ca7bcea386e024 2023-11-10 10:53:21,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o5cahscnc4eaf0hdd8ud8d1l2slf4bs7u8eu9oucd5e4hhr2t2t3vcif6fr0mrdv/family1/ad68f7b706f64e2793ca7bcea386e024 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_ 2023-11-10 10:53:21,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o5cahscnc4eaf0hdd8ud8d1l2slf4bs7u8eu9oucd5e4hhr2t2t3vcif6fr0mrdv/family1/ad68f7b706f64e2793ca7bcea386e024 into 4eef889b597ecf2d30eb14d14197ee04/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_ - updating store file list. 2023-11-10 10:53:21,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_ into 4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:21,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o5cahscnc4eaf0hdd8ud8d1l2slf4bs7u8eu9oucd5e4hhr2t2t3vcif6fr0mrdv/family1/ad68f7b706f64e2793ca7bcea386e024 into 4eef889b597ecf2d30eb14d14197ee04/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_) 2023-11-10 10:53:21,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__o5cahscnc4eaf0hdd8ud8d1l2slf4bs7u8eu9oucd5e4hhr2t2t3vcif6fr0mrdv/family1/ad68f7b706f64e2793ca7bcea386e024 2023-11-10 10:53:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:53:21,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:53:21,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 4eef889b597ecf2d30eb14d14197ee04/family1 is initiating minor compaction 2023-11-10 10:53:21,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@75dc13f9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:21,107 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4eef889b597ecf2d30eb14d14197ee04/family1 in testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:21,107 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/9694c1f00f684c83b83f6e9562f92f7e, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/79873329d0264379bbb6d3449155208d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/640c84f4351b44d5afac2990ce3fdebb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/dc0d8c5628e045088aa45d4e0ec59d29, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/02c78c67149e451e9eb9bed06ac99367, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/27c6c0e40bf44a9c917bf3e2e13289fb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/90de86705bf548288f89ba8c7b070595, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4c556d4ce9894aa29bbcada321d3dee8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/6ecf5e8eefb54b5abe3e03cbfb413130, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp, totalSize=49.7 K 2023-11-10 10:53:21,107 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 9694c1f00f684c83b83f6e9562f92f7e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 79873329d0264379bbb6d3449155208d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 640c84f4351b44d5afac2990ce3fdebb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting dc0d8c5628e045088aa45d4e0ec59d29, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 02c78c67149e451e9eb9bed06ac99367, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 27c6c0e40bf44a9c917bf3e2e13289fb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 90de86705bf548288f89ba8c7b070595, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 4c556d4ce9894aa29bbcada321d3dee8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 6ecf5e8eefb54b5abe3e03cbfb413130, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:53:21,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:53:21,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:21,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:21,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601012bfbd731dd5443378dce41976fe7a6fd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601012bfbd731dd5443378dce41976fe7a6fd 2023-11-10 10:53:21,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033caa7ca24ce347a1bd6b963af3c8e8fe to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033caa7ca24ce347a1bd6b963af3c8e8fe 2023-11-10 10:53:21,114 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-10 10:53:21,114 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-10 10:53:21,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:21,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:21,154 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4eef889b597ecf2d30eb14d14197ee04#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:21,596 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/bba54327769b49c885f6bec8d95e9375 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/bba54327769b49c885f6bec8d95e9375 2023-11-10 10:53:21,603 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4eef889b597ecf2d30eb14d14197ee04/family1 of 4eef889b597ecf2d30eb14d14197ee04 into bba54327769b49c885f6bec8d95e9375(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:21,603 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:21,603 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699613601107; duration=0sec 2023-11-10 10:53:21,603 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:21,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/9694c1f00f684c83b83f6e9562f92f7e, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/79873329d0264379bbb6d3449155208d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/640c84f4351b44d5afac2990ce3fdebb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/dc0d8c5628e045088aa45d4e0ec59d29, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/02c78c67149e451e9eb9bed06ac99367, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/27c6c0e40bf44a9c917bf3e2e13289fb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/90de86705bf548288f89ba8c7b070595, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4c556d4ce9894aa29bbcada321d3dee8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/6ecf5e8eefb54b5abe3e03cbfb413130, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_] to archive 2023-11-10 10:53:21,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:21,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/9694c1f00f684c83b83f6e9562f92f7e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/9694c1f00f684c83b83f6e9562f92f7e 2023-11-10 10:53:21,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/79873329d0264379bbb6d3449155208d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/79873329d0264379bbb6d3449155208d 2023-11-10 10:53:21,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/640c84f4351b44d5afac2990ce3fdebb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/640c84f4351b44d5afac2990ce3fdebb 2023-11-10 10:53:21,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/dc0d8c5628e045088aa45d4e0ec59d29 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/dc0d8c5628e045088aa45d4e0ec59d29 2023-11-10 10:53:21,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/02c78c67149e451e9eb9bed06ac99367 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/02c78c67149e451e9eb9bed06ac99367 2023-11-10 10:53:21,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/27c6c0e40bf44a9c917bf3e2e13289fb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/27c6c0e40bf44a9c917bf3e2e13289fb 2023-11-10 10:53:21,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/90de86705bf548288f89ba8c7b070595 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/90de86705bf548288f89ba8c7b070595 2023-11-10 10:53:21,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4c556d4ce9894aa29bbcada321d3dee8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4c556d4ce9894aa29bbcada321d3dee8 2023-11-10 10:53:21,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/6ecf5e8eefb54b5abe3e03cbfb413130 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/6ecf5e8eefb54b5abe3e03cbfb413130 2023-11-10 10:53:21,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/cdd6baa0a043490e8ff0d138c54db2df_SeqId_44_ 2023-11-10 10:53:22,005 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123187ba46f7137f47ab971b6ff7639da97c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123187ba46f7137f47ab971b6ff7639da97c 2023-11-10 10:53:22,006 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:22,048 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f3d0080a34874ac69b4022cd5de1a7ff first=Optional[r1] last=Optional[r4] 2023-11-10 10:53:22,049 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f3d0080a34874ac69b4022cd5de1a7ff}] 2023-11-10 10:53:22,052 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f3d0080a34874ac69b4022cd5de1a7ff for inclusion in 4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:22,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-10 10:53:22,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:22,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:22,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/f3d0080a34874ac69b4022cd5de1a7ff to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ou7o4rl7ngdgd381a0smfnpkcht9mds1kmkcviep7rikqt7asfk9rrrpaj909o1m/family1/f3d0080a34874ac69b4022cd5de1a7ff 2023-11-10 10:53:22,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ou7o4rl7ngdgd381a0smfnpkcht9mds1kmkcviep7rikqt7asfk9rrrpaj909o1m/family1/f3d0080a34874ac69b4022cd5de1a7ff as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_ 2023-11-10 10:53:22,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ou7o4rl7ngdgd381a0smfnpkcht9mds1kmkcviep7rikqt7asfk9rrrpaj909o1m/family1/f3d0080a34874ac69b4022cd5de1a7ff into 4eef889b597ecf2d30eb14d14197ee04/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_ - updating store file list. 2023-11-10 10:53:22,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_ into 4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:22,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ou7o4rl7ngdgd381a0smfnpkcht9mds1kmkcviep7rikqt7asfk9rrrpaj909o1m/family1/f3d0080a34874ac69b4022cd5de1a7ff into 4eef889b597ecf2d30eb14d14197ee04/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_) 2023-11-10 10:53:22,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ou7o4rl7ngdgd381a0smfnpkcht9mds1kmkcviep7rikqt7asfk9rrrpaj909o1m/family1/f3d0080a34874ac69b4022cd5de1a7ff 2023-11-10 10:53:22,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:53:22,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:53:22,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 4eef889b597ecf2d30eb14d14197ee04/family1 is initiating minor compaction (all files) 2023-11-10 10:53:22,073 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4eef889b597ecf2d30eb14d14197ee04/family1 in testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:53:22,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@214be56a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:22,073 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/ec6d5ebae99b4feb96b5eee028c1eca8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/bba54327769b49c885f6bec8d95e9375, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp, totalSize=178.1 K 2023-11-10 10:53:22,074 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting ec6d5ebae99b4feb96b5eee028c1eca8, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:53:22,075 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting bba54327769b49c885f6bec8d95e9375, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:53:22,076 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 18325f61d1654921900f95dec74301d8_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965254600 2023-11-10 10:53:22,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:22,079 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:22,085 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012094e90853c740738d905875dd88f331 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012094e90853c740738d905875dd88f331 2023-11-10 10:53:22,089 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205507fe67389694dd4bc42aba2dd23d36d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205507fe67389694dd4bc42aba2dd23d36d 2023-11-10 10:53:22,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228601c1721a6004fef924c6f142d9e55fb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228601c1721a6004fef924c6f142d9e55fb 2023-11-10 10:53:22,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317716cf3233fd4c05b718de9906f7746e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512317716cf3233fd4c05b718de9906f7746e 2023-11-10 10:53:22,093 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-10 10:53:22,093 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-10 10:53:22,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:22,094 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:22,138 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4eef889b597ecf2d30eb14d14197ee04#family1#compaction#23 average throughput is 6.48 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:22,228 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301c3195d8db134dbfbc66726802cc61e0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511301c3195d8db134dbfbc66726802cc61e0 2023-11-10 10:53:22,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:22,260 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e4e996e8508e40dca41520163c86e1e8 first=Optional[r00] last=Optional[r8] 2023-11-10 10:53:22,261 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e4e996e8508e40dca41520163c86e1e8}] 2023-11-10 10:53:22,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e4e996e8508e40dca41520163c86e1e8 for inclusion in 4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-10 10:53:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:22,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/e4e996e8508e40dca41520163c86e1e8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__254su1i9thqbb7t9dds21f65slkhgb9bq1a179cp29muv1j8ibc5j4jhnnenqbpr/family1/e4e996e8508e40dca41520163c86e1e8 2023-11-10 10:53:22,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__254su1i9thqbb7t9dds21f65slkhgb9bq1a179cp29muv1j8ibc5j4jhnnenqbpr/family1/e4e996e8508e40dca41520163c86e1e8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4aa57adc72cf4b0daed7801c8f23ea02_SeqId_49_ 2023-11-10 10:53:22,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__254su1i9thqbb7t9dds21f65slkhgb9bq1a179cp29muv1j8ibc5j4jhnnenqbpr/family1/e4e996e8508e40dca41520163c86e1e8 into 4eef889b597ecf2d30eb14d14197ee04/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4aa57adc72cf4b0daed7801c8f23ea02_SeqId_49_ - updating store file list. 2023-11-10 10:53:22,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4aa57adc72cf4b0daed7801c8f23ea02_SeqId_49_ into 4eef889b597ecf2d30eb14d14197ee04/family1 2023-11-10 10:53:22,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__254su1i9thqbb7t9dds21f65slkhgb9bq1a179cp29muv1j8ibc5j4jhnnenqbpr/family1/e4e996e8508e40dca41520163c86e1e8 into 4eef889b597ecf2d30eb14d14197ee04/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/4aa57adc72cf4b0daed7801c8f23ea02_SeqId_49_) 2023-11-10 10:53:22,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__254su1i9thqbb7t9dds21f65slkhgb9bq1a179cp29muv1j8ibc5j4jhnnenqbpr/family1/e4e996e8508e40dca41520163c86e1e8 2023-11-10 10:53:22,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:22,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:22,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e11094b48a9145e589da60755acf1325 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120e11094b48a9145e589da60755acf1325 2023-11-10 10:53:22,291 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281a515bf0795542d8bd13e7b90454733c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511281a515bf0795542d8bd13e7b90454733c 2023-11-10 10:53:22,294 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130af7852072b4f46db87647f7e961a1da5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130af7852072b4f46db87647f7e961a1da5 2023-11-10 10:53:22,294 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-10 10:53:22,294 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-10 10:53:22,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:22,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:22,295 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:53:22,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:53:22,295 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:22,296 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:22,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.1070 sec 2023-11-10 10:53:22,426 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=264 (was 253) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50376 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x3f9305d0-SendThread(127.0.0.1:62972) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50462 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50356 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-485 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50396 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xffdaf99-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50420 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231143d4f24278f4613808b4497a2ac5b79_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50448 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50360 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xffdaf99-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50362 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50308 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xffdaf99-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50406 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50480 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50414 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_17143165_17 at /127.0.0.1:50520 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-806049384-148.251.75.209-1699613567068:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xffdaf99-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50454 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xffdaf99-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50478 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50334 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x3f9305d0-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0xffdaf99-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62972@0x3f9305d0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/624005578.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212579261_17 at /127.0.0.1:50526 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_17143165_17 at /127.0.0.1:50536 [Receiving block BP-806049384-148.251.75.209-1699613567068:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-806049384-148.251.75.209-1699613567068:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: hconnection-0xffdaf99-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/0e7c1698ba0d400cabe1142340bc3d39 block BP-806049384-148.251.75.209-1699613567068:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) - Thread LEAK? -, OpenFileDescriptor=644 (was 623) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 257), ProcessCount=166 (was 169), AvailableMemoryMB=8627 (was 8944) 2023-11-10 10:53:22,438 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=166, AvailableMemoryMB=8626 2023-11-10 10:53:22,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-10 10:53:22,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:22,444 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:53:22,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-10 10:53:22,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-10 10:53:22,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:53:22,446 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:22,447 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86 empty. 2023-11-10 10:53:22,448 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:22,448 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-10 10:53:22,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-10 10:53:22,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-10 10:53:22,862 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-10 10:53:22,863 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 967b16d4c017fd910dfe7c1d1ea18d86, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:23,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-10 10:53:23,277 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:23,278 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 967b16d4c017fd910dfe7c1d1ea18d86, disabling compactions & flushes 2023-11-10 10:53:23,278 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,278 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,278 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. after waiting 0 ms 2023-11-10 10:53:23,278 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,278 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,278 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:23,281 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:53:23,282 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699613603281"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613603281"}]},"ts":"1699613603281"} 2023-11-10 10:53:23,283 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:53:23,284 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:53:23,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613603285"}]},"ts":"1699613603285"} 2023-11-10 10:53:23,286 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-10 10:53:23,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=967b16d4c017fd910dfe7c1d1ea18d86, ASSIGN}] 2023-11-10 10:53:23,290 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=967b16d4c017fd910dfe7c1d1ea18d86, ASSIGN 2023-11-10 10:53:23,291 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=967b16d4c017fd910dfe7c1d1ea18d86, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:23,411 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/.tmp/family1/0e7c1698ba0d400cabe1142340bc3d39 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/0e7c1698ba0d400cabe1142340bc3d39 2023-11-10 10:53:23,418 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4eef889b597ecf2d30eb14d14197ee04/family1 of 4eef889b597ecf2d30eb14d14197ee04 into 0e7c1698ba0d400cabe1142340bc3d39(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:53:23,418 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:53:23,418 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699613602073; duration=1sec 2023-11-10 10:53:23,418 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:23,442 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=967b16d4c017fd910dfe7c1d1ea18d86, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:23,442 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699613603441"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613603441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613603441"}]},"ts":"1699613603441"} 2023-11-10 10:53:23,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 967b16d4c017fd910dfe7c1d1ea18d86, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:23,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/ec6d5ebae99b4feb96b5eee028c1eca8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/bba54327769b49c885f6bec8d95e9375, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_] to archive 2023-11-10 10:53:23,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:23,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/ec6d5ebae99b4feb96b5eee028c1eca8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/ec6d5ebae99b4feb96b5eee028c1eca8 2023-11-10 10:53:23,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/bba54327769b49c885f6bec8d95e9375 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/bba54327769b49c885f6bec8d95e9375 2023-11-10 10:53:23,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/family1/18325f61d1654921900f95dec74301d8_SeqId_47_ 2023-11-10 10:53:23,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-10 10:53:23,596 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:23,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 967b16d4c017fd910dfe7c1d1ea18d86, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:53:23,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:23,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,601 INFO [StoreOpener-967b16d4c017fd910dfe7c1d1ea18d86-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,604 DEBUG [StoreOpener-967b16d4c017fd910dfe7c1d1ea18d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1 2023-11-10 10:53:23,604 DEBUG [StoreOpener-967b16d4c017fd910dfe7c1d1ea18d86-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1 2023-11-10 10:53:23,604 INFO [StoreOpener-967b16d4c017fd910dfe7c1d1ea18d86-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 967b16d4c017fd910dfe7c1d1ea18d86 columnFamilyName family1 2023-11-10 10:53:23,606 INFO [StoreOpener-967b16d4c017fd910dfe7c1d1ea18d86-1] regionserver.HStore(310): Store=967b16d4c017fd910dfe7c1d1ea18d86/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:23,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:53:23,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:23,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 967b16d4c017fd910dfe7c1d1ea18d86; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72497051, jitterRate=0.08029024302959442}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:53:23,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:23,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86., pid=25, masterSystemTime=1699613603596 2023-11-10 10:53:23,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:23,621 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=967b16d4c017fd910dfe7c1d1ea18d86, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:23,621 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699613603621"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613603621"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613603621"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613603621"}]},"ts":"1699613603621"} 2023-11-10 10:53:23,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-10 10:53:23,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 967b16d4c017fd910dfe7c1d1ea18d86, server=jenkins-hbase20.apache.org,43721,1699613570510 in 179 msec 2023-11-10 10:53:23,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-10 10:53:23,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=967b16d4c017fd910dfe7c1d1ea18d86, ASSIGN in 337 msec 2023-11-10 10:53:23,630 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:53:23,631 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613603630"}]},"ts":"1699613603630"} 2023-11-10 10:53:23,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-10 10:53:23,636 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:53:23,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1960 sec 2023-11-10 10:53:24,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-10 10:53:24,553 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-10 10:53:24,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:24,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,583 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:24,583 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:24,583 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:24,583 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:24,583 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,583 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,584 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:24,584 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:24,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:24,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:24,585 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:24,585 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:24,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:24,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:24,585 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:24,586 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:24,586 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:24,586 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:24,586 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:24,586 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:24,586 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:24,587 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:53:25,022 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301c2d99ddb701476c9af7390df7df3d57 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511301c2d99ddb701476c9af7390df7df3d57 2023-11-10 10:53:25,429 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/fc8ef6d388fd4013a644358efd42dd3b 2023-11-10 10:53:25,442 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/fc8ef6d388fd4013a644358efd42dd3b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/fc8ef6d388fd4013a644358efd42dd3b 2023-11-10 10:53:25,450 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/fc8ef6d388fd4013a644358efd42dd3b, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-10 10:53:25,451 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 864ms, sequenceid=5, compaction requested=false 2023-11-10 10:53:25,451 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:25,452 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:25,452 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:25,452 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:25,452 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:25,452 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,452 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:25,452 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:25,453 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,453 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:25,454 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:25,454 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:25,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:25,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:25,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49929837[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:25,456 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:25,456 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,456 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,457 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:25,457 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:25,457 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:25,457 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,457 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:25,458 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,458 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:25,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:25,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:25,458 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:25,458 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:25,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:25,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:25,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:25,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:25,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:25,460 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:25,460 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:25,461 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:25,461 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,461 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:25,462 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,462 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:25,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:25,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,462 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:25,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:25,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:25,463 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:25,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,465 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:25,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:25,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:25,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,467 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:25,467 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,468 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:25,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:25,468 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:25,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:25,568 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:25,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:25,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:25,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:25,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,585 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:25,585 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:25,586 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:25,586 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:25,587 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,587 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,589 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:25,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:25,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:25,589 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:25,589 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:25,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:25,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,592 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,592 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:25,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:25,593 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:25,593 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:25,593 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:25,593 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:25,593 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:25,593 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:25,593 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:25,593 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:53:26,012 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112891d527500f8d4794b407c76e57af0788 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015112891d527500f8d4794b407c76e57af0788 2023-11-10 10:53:26,019 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/f0a534b66b234b6480bec9853222129d 2023-11-10 10:53:26,025 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/f0a534b66b234b6480bec9853222129d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0a534b66b234b6480bec9853222129d 2023-11-10 10:53:26,031 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0a534b66b234b6480bec9853222129d, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:53:26,032 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 439ms, sequenceid=9, compaction requested=false 2023-11-10 10:53:26,032 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:26,032 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:26,032 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:26,032 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:26,032 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,032 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:26,032 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:26,035 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,035 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:26,036 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,036 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:26,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:26,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:26,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a0d70d9[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:26,038 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:26,038 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,038 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,039 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:26,039 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,039 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:26,039 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:26,039 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:26,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:26,040 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:26,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:26,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:26,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:26,042 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:26,042 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:26,042 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:26,042 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,042 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:26,043 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,043 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:26,043 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:26,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:26,044 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,045 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:26,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:26,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:26,047 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:26,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:26,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,048 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:26,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,048 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:26,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:26,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:26,148 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:26,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:26,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:26,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:26,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,156 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:26,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:26,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:26,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:26,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,157 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:26,157 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:26,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:26,158 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:26,158 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:26,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,158 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,159 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:26,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:26,159 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:26,159 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:26,159 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:26,160 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:26,160 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:26,160 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:26,160 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:26,160 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:26,584 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014ae0068c402e49cba9a741ff8c90f6ff to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014ae0068c402e49cba9a741ff8c90f6ff 2023-11-10 10:53:26,992 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/ecdb71091c214ca0af22766ca621a4f4 2023-11-10 10:53:27,006 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/ecdb71091c214ca0af22766ca621a4f4 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/ecdb71091c214ca0af22766ca621a4f4 2023-11-10 10:53:27,015 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/ecdb71091c214ca0af22766ca621a4f4, entries=1, sequenceid=13, filesize=4.9 K 2023-11-10 10:53:27,016 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 856ms, sequenceid=13, compaction requested=true 2023-11-10 10:53:27,016 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:27,016 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:27,016 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:27,016 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:27,017 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,017 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:27,017 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:27,018 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,018 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,019 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:27,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:27,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:27,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@779768c1[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:27,021 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:27,021 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,023 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,023 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:27,023 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:27,023 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,023 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:27,023 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:27,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:27,024 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:27,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:27,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:27,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:27,027 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:27,027 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:27,027 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:27,027 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,027 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:27,028 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,028 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:27,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:27,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,028 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:27,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:27,029 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,030 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,032 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:27,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:27,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:27,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,033 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,033 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,033 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:27,033 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:27,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:27,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:27,133 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:27,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:27,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:27,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:27,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,149 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:27,149 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:27,149 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:27,149 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:27,151 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,151 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,153 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,153 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:27,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:27,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:27,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:27,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:27,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:27,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:27,158 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:27,158 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:27,158 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:27,158 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:27,176 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057304f30f5e524b1facd67c13374ed4ee to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057304f30f5e524b1facd67c13374ed4ee 2023-11-10 10:53:27,581 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/a489bfc69b1046cba423024f01d05f11 2023-11-10 10:53:27,590 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/a489bfc69b1046cba423024f01d05f11 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a489bfc69b1046cba423024f01d05f11 2023-11-10 10:53:27,599 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a489bfc69b1046cba423024f01d05f11, entries=1, sequenceid=17, filesize=4.9 K 2023-11-10 10:53:27,600 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 442ms, sequenceid=17, compaction requested=true 2023-11-10 10:53:27,600 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:27,601 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:27,601 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:27,601 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:27,601 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,601 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:27,601 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:27,603 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,603 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:27,603 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,603 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:27,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:27,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:27,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:27,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:27,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3402acf1[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:27,605 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:27,605 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,606 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,606 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:27,606 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:27,606 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:27,607 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,607 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:27,608 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:27,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:27,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:27,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:27,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:27,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:27,611 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:27,611 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:27,611 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:27,611 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,611 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:27,612 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,612 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,612 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:27,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:27,613 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:27,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:27,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,615 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,618 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,618 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,618 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:27,618 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,618 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:27,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:27,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:27,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:27,618 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,619 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,619 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,619 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:27,618 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:27,619 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:27,619 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:27,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:27,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:27,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:27,719 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:27,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:27,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:27,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:27,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,728 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:27,728 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:27,728 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:27,728 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:27,729 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,729 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,730 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:27,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:27,731 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:27,731 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:27,731 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:27,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:27,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,733 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:27,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:27,734 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:27,734 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:27,734 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:27,734 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:27,756 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f4d142153ac44692aa5dcf347cbfdc91 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f4d142153ac44692aa5dcf347cbfdc91 2023-11-10 10:53:28,166 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/eee03f8191764bcc8c9d86d494d60646 2023-11-10 10:53:28,178 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/eee03f8191764bcc8c9d86d494d60646 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/eee03f8191764bcc8c9d86d494d60646 2023-11-10 10:53:28,186 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/eee03f8191764bcc8c9d86d494d60646, entries=1, sequenceid=21, filesize=4.9 K 2023-11-10 10:53:28,187 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 453ms, sequenceid=21, compaction requested=true 2023-11-10 10:53:28,187 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:28,187 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:28,187 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:28,187 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:28,187 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,187 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:28,187 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:28,189 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,189 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:28,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:28,189 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:28,189 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:28,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:28,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@690cd966[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:28,191 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:28,191 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,192 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,192 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:28,192 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:28,192 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,192 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:28,192 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:28,194 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:28,194 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:28,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:28,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:28,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:28,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:28,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:28,197 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:28,197 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:28,197 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:28,197 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,197 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:28,207 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,207 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:28,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:28,207 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:28,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:28,208 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:28,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,209 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,210 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:28,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:28,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:28,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:28,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,210 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:28,211 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:28,211 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,211 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:28,211 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:28,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:28,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:28,311 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:28,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:28,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:28,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:28,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,319 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:28,319 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:28,319 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:28,319 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:28,320 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,320 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,321 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,321 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:28,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:28,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:28,322 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:28,322 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,323 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,323 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:28,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:28,324 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:28,324 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:28,324 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:28,324 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:28,324 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:28,324 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:28,324 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:28,324 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:28,742 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316b63e01e0bf34d4cb0a8f637b409bd16 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316b63e01e0bf34d4cb0a8f637b409bd16 2023-11-10 10:53:29,139 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:53:29,150 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/1951399b04094701aa2903034b165c3b 2023-11-10 10:53:29,156 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/1951399b04094701aa2903034b165c3b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1951399b04094701aa2903034b165c3b 2023-11-10 10:53:29,162 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1951399b04094701aa2903034b165c3b, entries=1, sequenceid=25, filesize=4.9 K 2023-11-10 10:53:29,163 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 839ms, sequenceid=25, compaction requested=true 2023-11-10 10:53:29,163 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:29,164 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:29,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:29,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:29,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:29,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:29,165 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,165 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:29,166 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,166 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:29,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:29,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:29,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:29,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:29,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7896e726[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:29,167 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:29,167 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,168 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,168 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:29,168 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:29,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,169 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:29,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:29,170 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:29,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:29,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:29,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:29,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:29,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:29,172 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:29,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:29,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:29,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,173 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:29,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:29,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:29,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:29,175 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:29,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,176 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:29,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:29,178 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:29,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:29,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:29,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,178 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,179 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:29,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:29,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:29,179 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:29,279 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:29,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:29,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:29,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:29,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,286 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:29,286 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:29,286 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:29,286 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:29,287 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,287 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,288 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:29,288 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:29,289 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:29,289 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:29,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:29,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:29,290 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:29,290 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:29,290 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:29,706 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b71d41208cb3448583e87548b1121615 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101b71d41208cb3448583e87548b1121615 2023-11-10 10:53:30,113 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/e55c929df049474992a62261a4ce2ab9 2023-11-10 10:53:30,119 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/e55c929df049474992a62261a4ce2ab9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e55c929df049474992a62261a4ce2ab9 2023-11-10 10:53:30,123 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e55c929df049474992a62261a4ce2ab9, entries=1, sequenceid=29, filesize=4.9 K 2023-11-10 10:53:30,124 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 834ms, sequenceid=29, compaction requested=true 2023-11-10 10:53:30,124 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:30,124 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:30,124 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:30,124 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:30,125 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,125 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:30,125 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:30,126 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,126 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:30,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:30,127 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,127 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:30,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:30,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:30,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@348b5995[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:30,129 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:30,129 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,130 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,130 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:30,130 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:30,130 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:30,130 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,130 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:30,132 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:30,132 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:30,132 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:30,132 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:30,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:30,135 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:30,135 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:30,135 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:30,135 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,135 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:30,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:30,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,136 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:30,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:30,137 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:30,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:30,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:30,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:30,141 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:30,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:30,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:30,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:30,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,142 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,142 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,142 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,142 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:30,142 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:30,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:30,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:30,242 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:30,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:30,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:30,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:30,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,256 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:30,256 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:30,256 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:30,256 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:30,257 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,257 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,258 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:30,258 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:30,259 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,259 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,261 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:30,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,262 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:30,262 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:30,262 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:30,262 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:30,262 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:30,262 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:30,262 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:30,262 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:30,284 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030d7c66355fb54912bc037028dbb62c84 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030d7c66355fb54912bc037028dbb62c84 2023-11-10 10:53:30,693 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/1e54dd5254f74bc993e31c2d73c0ec8f 2023-11-10 10:53:30,705 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/1e54dd5254f74bc993e31c2d73c0ec8f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1e54dd5254f74bc993e31c2d73c0ec8f 2023-11-10 10:53:30,712 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1e54dd5254f74bc993e31c2d73c0ec8f, entries=1, sequenceid=33, filesize=4.9 K 2023-11-10 10:53:30,713 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 451ms, sequenceid=33, compaction requested=true 2023-11-10 10:53:30,713 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:30,713 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:30,713 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:30,713 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:30,713 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,713 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:30,713 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:30,715 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,715 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:30,715 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,715 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:30,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:30,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:30,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15cf0ed1[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:30,717 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:30,717 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,718 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,718 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:30,718 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:30,718 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:30,719 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,719 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:30,720 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:30,720 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,720 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:30,720 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:30,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:30,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:30,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:30,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:30,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:30,724 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:30,724 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:30,724 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:30,724 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,724 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:30,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:30,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:30,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:30,734 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:30,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,736 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:30,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,741 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,741 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,741 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,741 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:30,741 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:30,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:30,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:30,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:30,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:30,741 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:30,741 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:30,742 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:30,742 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:30,742 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,742 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,743 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:30,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:30,842 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:30,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:30,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:30,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:30,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,859 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:30,859 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:30,859 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:30,859 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:30,860 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,860 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,861 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:30,861 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:30,861 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:30,861 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,862 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:30,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:30,862 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:30,863 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:30,863 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:30,863 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:30,863 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:30,863 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:31,276 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090724a35590e6724dfb9a997b0b8ec0222d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090724a35590e6724dfb9a997b0b8ec0222d 2023-11-10 10:53:31,683 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/f0dd8f5533ae4d429b2a98569f66008d 2023-11-10 10:53:31,696 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/f0dd8f5533ae4d429b2a98569f66008d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0dd8f5533ae4d429b2a98569f66008d 2023-11-10 10:53:31,702 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0dd8f5533ae4d429b2a98569f66008d, entries=1, sequenceid=37, filesize=4.9 K 2023-11-10 10:53:31,703 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 840ms, sequenceid=37, compaction requested=true 2023-11-10 10:53:31,703 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:31,703 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:31,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:31,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:31,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:31,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:31,705 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,705 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:31,705 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,706 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:31,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a0732e7[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:31,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:31,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,709 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,709 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:31,709 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:31,709 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:31,709 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,709 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:31,710 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:31,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:31,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:31,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:31,713 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:31,713 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:31,713 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:31,713 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,713 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:31,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:31,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:31,714 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:31,716 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:31,717 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:31,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:31,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:31,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:31,717 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,718 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,718 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,718 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:31,718 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:31,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:31,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:31,818 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:31,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:31,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:31,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,834 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:31,834 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:31,834 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:31,834 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:31,835 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,835 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:31,837 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:31,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,838 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:31,838 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:31,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,839 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:31,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:31,840 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:31,840 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:31,840 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:31,840 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:31,840 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:31,840 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:31,840 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. started... 2023-11-10 10:53:31,840 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 967b16d4c017fd910dfe7c1d1ea18d86 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:32,268 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203f5e8d19bf6c43209f17dbee7764e31f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511203f5e8d19bf6c43209f17dbee7764e31f 2023-11-10 10:53:32,675 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/e1548cc02b3f4623935ea51a29f0e42f 2023-11-10 10:53:32,688 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/e1548cc02b3f4623935ea51a29f0e42f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e1548cc02b3f4623935ea51a29f0e42f 2023-11-10 10:53:32,695 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e1548cc02b3f4623935ea51a29f0e42f, entries=1, sequenceid=41, filesize=4.9 K 2023-11-10 10:53:32,697 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 967b16d4c017fd910dfe7c1d1ea18d86 in 857ms, sequenceid=41, compaction requested=true 2023-11-10 10:53:32,697 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:32,697 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:32,697 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:32,697 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:32,697 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,697 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:32,697 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:32,700 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,700 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:32,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:32,700 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,700 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:32,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:32,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:32,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55675956[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:32,702 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:32,702 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,703 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:32,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:32,704 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,704 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:32,705 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:32,705 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,705 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,705 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:32,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:32,707 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:32,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:32,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:32,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,707 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:32,709 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:32,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:32,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,715 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,716 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,732 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:32,733 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-10 10:53:32,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:32,733 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:32,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:32,734 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:32,834 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:32,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:32,837 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-10 10:53:32,839 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:32,841 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:32,842 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:32,843 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614212842 2023-11-10 10:53:32,844 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-10 10:53:32,846 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-10 10:53:32,847 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:32,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x22e4d6de to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:32,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425375d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:32,854 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,701 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c5b042a238af47c1a3217bf7ae43cc4b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103c5b042a238af47c1a3217bf7ae43cc4b 2023-11-10 10:53:33,704 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:33,716 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:53:33,717 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:53:33,724 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:53:33,726 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:53:33,738 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/108b01e34d8c47fe84d8054609a5a062 first=Optional[r3] last=Optional[r6] 2023-11-10 10:53:33,739 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/108b01e34d8c47fe84d8054609a5a062}] 2023-11-10 10:53:33,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/108b01e34d8c47fe84d8054609a5a062 for inclusion in 967b16d4c017fd910dfe7c1d1ea18d86/family1 2023-11-10 10:53:33,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-10 10:53:33,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:33,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:33,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/108b01e34d8c47fe84d8054609a5a062 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1s41p0poe6dps1lja6r52b4svqrsoetlkjhe47k86da3svs4c648iop7r0o5ivuh/family1/108b01e34d8c47fe84d8054609a5a062 2023-11-10 10:53:33,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1s41p0poe6dps1lja6r52b4svqrsoetlkjhe47k86da3svs4c648iop7r0o5ivuh/family1/108b01e34d8c47fe84d8054609a5a062 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_ 2023-11-10 10:53:33,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1s41p0poe6dps1lja6r52b4svqrsoetlkjhe47k86da3svs4c648iop7r0o5ivuh/family1/108b01e34d8c47fe84d8054609a5a062 into 967b16d4c017fd910dfe7c1d1ea18d86/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_ - updating store file list. 2023-11-10 10:53:33,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_ into 967b16d4c017fd910dfe7c1d1ea18d86/family1 2023-11-10 10:53:33,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1s41p0poe6dps1lja6r52b4svqrsoetlkjhe47k86da3svs4c648iop7r0o5ivuh/family1/108b01e34d8c47fe84d8054609a5a062 into 967b16d4c017fd910dfe7c1d1ea18d86/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_) 2023-11-10 10:53:33,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__1s41p0poe6dps1lja6r52b4svqrsoetlkjhe47k86da3svs4c648iop7r0o5ivuh/family1/108b01e34d8c47fe84d8054609a5a062 2023-11-10 10:53:33,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:53:33,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:53:33,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 967b16d4c017fd910dfe7c1d1ea18d86/family1 is initiating minor compaction 2023-11-10 10:53:33,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@12c1217d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-10 10:53:33,767 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 967b16d4c017fd910dfe7c1d1ea18d86/family1 in testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:33,767 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0a534b66b234b6480bec9853222129d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/ecdb71091c214ca0af22766ca621a4f4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a489bfc69b1046cba423024f01d05f11, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/eee03f8191764bcc8c9d86d494d60646, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1951399b04094701aa2903034b165c3b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e55c929df049474992a62261a4ce2ab9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1e54dd5254f74bc993e31c2d73c0ec8f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0dd8f5533ae4d429b2a98569f66008d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e1548cc02b3f4623935ea51a29f0e42f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp, totalSize=50.0 K 2023-11-10 10:53:33,767 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting f0a534b66b234b6480bec9853222129d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:53:33,767 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting ecdb71091c214ca0af22766ca621a4f4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:53:33,767 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting a489bfc69b1046cba423024f01d05f11, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:53:33,767 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting eee03f8191764bcc8c9d86d494d60646, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:53:33,767 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 1951399b04094701aa2903034b165c3b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:53:33,767 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting e55c929df049474992a62261a4ce2ab9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:53:33,768 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 1e54dd5254f74bc993e31c2d73c0ec8f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:53:33,768 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting f0dd8f5533ae4d429b2a98569f66008d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:53:33,768 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting e1548cc02b3f4623935ea51a29f0e42f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:53:33,768 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 4205278ab45c410c9d2f62efbc7f002a_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:53:33,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:33,770 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:33,772 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f4d142153ac44692aa5dcf347cbfdc91 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f4d142153ac44692aa5dcf347cbfdc91 2023-11-10 10:53:33,774 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316b63e01e0bf34d4cb0a8f637b409bd16 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512316b63e01e0bf34d4cb0a8f637b409bd16 2023-11-10 10:53:33,775 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101b71d41208cb3448583e87548b1121615 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101b71d41208cb3448583e87548b1121615 2023-11-10 10:53:33,776 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030d7c66355fb54912bc037028dbb62c84 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030d7c66355fb54912bc037028dbb62c84 2023-11-10 10:53:33,776 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-10 10:53:33,776 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,777 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:33,797 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 967b16d4c017fd910dfe7c1d1ea18d86#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:34,627 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f9305b3ba53145a2a0bb1536cf77e3c6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205f9305b3ba53145a2a0bb1536cf77e3c6 2023-11-10 10:53:34,628 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:34,628 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/35edcb47f91d49bb8ac05a03d6eb964f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/35edcb47f91d49bb8ac05a03d6eb964f 2023-11-10 10:53:34,636 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 967b16d4c017fd910dfe7c1d1ea18d86/family1 of 967b16d4c017fd910dfe7c1d1ea18d86 into 35edcb47f91d49bb8ac05a03d6eb964f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:34,636 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:34,637 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699613613767; duration=0sec 2023-11-10 10:53:34,637 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:34,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 first=Optional[r1] last=Optional[r2] 2023-11-10 10:53:34,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88}] 2023-11-10 10:53:34,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 for inclusion in 967b16d4c017fd910dfe7c1d1ea18d86/family1 2023-11-10 10:53:34,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-10 10:53:34,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:34,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:34,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__71vdqci0rjm7h19pd54nr6q1kvlocntse76o1dn9vm4rh3c4p9t3f8ujhk1c0ssq/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 2023-11-10 10:53:34,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__71vdqci0rjm7h19pd54nr6q1kvlocntse76o1dn9vm4rh3c4p9t3f8ujhk1c0ssq/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_ 2023-11-10 10:53:34,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__71vdqci0rjm7h19pd54nr6q1kvlocntse76o1dn9vm4rh3c4p9t3f8ujhk1c0ssq/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 into 967b16d4c017fd910dfe7c1d1ea18d86/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_ - updating store file list. 2023-11-10 10:53:34,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_ into 967b16d4c017fd910dfe7c1d1ea18d86/family1 2023-11-10 10:53:34,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__71vdqci0rjm7h19pd54nr6q1kvlocntse76o1dn9vm4rh3c4p9t3f8ujhk1c0ssq/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 into 967b16d4c017fd910dfe7c1d1ea18d86/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_) 2023-11-10 10:53:34,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__71vdqci0rjm7h19pd54nr6q1kvlocntse76o1dn9vm4rh3c4p9t3f8ujhk1c0ssq/family1/1aa99f1d9b9b4bb9a2f244e8c5ac5f88 2023-11-10 10:53:34,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:53:34,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:53:34,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 967b16d4c017fd910dfe7c1d1ea18d86/family1 is initiating minor compaction (all files) 2023-11-10 10:53:34,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35fafda4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-10 10:53:34,674 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 967b16d4c017fd910dfe7c1d1ea18d86/family1 in testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:53:34,675 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/fc8ef6d388fd4013a644358efd42dd3b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/35edcb47f91d49bb8ac05a03d6eb964f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp, totalSize=176.8 K 2023-11-10 10:53:34,675 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting fc8ef6d388fd4013a644358efd42dd3b, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:53:34,676 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 35edcb47f91d49bb8ac05a03d6eb964f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:53:34,676 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 5685825dfe4f460a9264b8d69316ae0d_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965254600 2023-11-10 10:53:34,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:34,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:34,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014ae0068c402e49cba9a741ff8c90f6ff to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512014ae0068c402e49cba9a741ff8c90f6ff 2023-11-10 10:53:34,682 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057304f30f5e524b1facd67c13374ed4ee to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512057304f30f5e524b1facd67c13374ed4ee 2023-11-10 10:53:34,682 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-10 10:53:34,682 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-10 10:53:34,683 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:34,683 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:34,683 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:34,685 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:34,695 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8470 sec 2023-11-10 10:53:34,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0a534b66b234b6480bec9853222129d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/ecdb71091c214ca0af22766ca621a4f4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a489bfc69b1046cba423024f01d05f11, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/eee03f8191764bcc8c9d86d494d60646, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1951399b04094701aa2903034b165c3b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e55c929df049474992a62261a4ce2ab9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1e54dd5254f74bc993e31c2d73c0ec8f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0dd8f5533ae4d429b2a98569f66008d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e1548cc02b3f4623935ea51a29f0e42f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_] to archive 2023-11-10 10:53:34,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:34,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0a534b66b234b6480bec9853222129d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0a534b66b234b6480bec9853222129d 2023-11-10 10:53:34,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/ecdb71091c214ca0af22766ca621a4f4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/ecdb71091c214ca0af22766ca621a4f4 2023-11-10 10:53:34,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a489bfc69b1046cba423024f01d05f11 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a489bfc69b1046cba423024f01d05f11 2023-11-10 10:53:34,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/eee03f8191764bcc8c9d86d494d60646 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/eee03f8191764bcc8c9d86d494d60646 2023-11-10 10:53:34,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1951399b04094701aa2903034b165c3b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1951399b04094701aa2903034b165c3b 2023-11-10 10:53:34,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e55c929df049474992a62261a4ce2ab9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e55c929df049474992a62261a4ce2ab9 2023-11-10 10:53:34,709 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 967b16d4c017fd910dfe7c1d1ea18d86#family1#compaction#35 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:34,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1e54dd5254f74bc993e31c2d73c0ec8f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/1e54dd5254f74bc993e31c2d73c0ec8f 2023-11-10 10:53:34,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0dd8f5533ae4d429b2a98569f66008d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/f0dd8f5533ae4d429b2a98569f66008d 2023-11-10 10:53:34,715 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e1548cc02b3f4623935ea51a29f0e42f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/e1548cc02b3f4623935ea51a29f0e42f 2023-11-10 10:53:34,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/4205278ab45c410c9d2f62efbc7f002a_SeqId_44_ 2023-11-10 10:53:34,727 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-11-10 10:53:34,798 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=263 (was 264), OpenFileDescriptor=648 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 252), ProcessCount=166 (was 166), AvailableMemoryMB=8416 (was 8626) 2023-11-10 10:53:34,811 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=263, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=166, AvailableMemoryMB=8415 2023-11-10 10:53:34,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-10 10:53:34,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:34,816 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:53:34,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-10 10:53:34,817 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:53:34,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-10 10:53:34,819 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:34,819 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:34,819 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:34,820 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e empty. 2023-11-10 10:53:34,820 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864 empty. 2023-11-10 10:53:34,820 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a empty. 2023-11-10 10:53:34,820 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:34,820 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:34,822 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:34,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-10 10:53:34,833 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-10 10:53:34,835 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d2ce2a7600c83ffbc19dedfaf004b7e, NAME => 'testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:34,835 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => b908cc77579006daf878d3b2dd1b0a7a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:34,835 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => b5388fe6b3c513779c89d7cabf105864, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing b5388fe6b3c513779c89d7cabf105864, disabling compactions & flushes 2023-11-10 10:53:34,852 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. after waiting 0 ms 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:34,852 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for b5388fe6b3c513779c89d7cabf105864: 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:34,852 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 5d2ce2a7600c83ffbc19dedfaf004b7e, disabling compactions & flushes 2023-11-10 10:53:34,852 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:34,853 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:34,853 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. after waiting 0 ms 2023-11-10 10:53:34,853 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:34,853 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:34,853 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 5d2ce2a7600c83ffbc19dedfaf004b7e: 2023-11-10 10:53:34,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-10 10:53:35,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-10 10:53:35,252 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:35,252 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing b908cc77579006daf878d3b2dd1b0a7a, disabling compactions & flushes 2023-11-10 10:53:35,253 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,253 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,253 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. after waiting 0 ms 2023-11-10 10:53:35,253 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,253 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,253 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:53:35,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:53:35,260 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699613615260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613615260"}]},"ts":"1699613615260"} 2023-11-10 10:53:35,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699613615260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613615260"}]},"ts":"1699613615260"} 2023-11-10 10:53:35,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699613615260"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613615260"}]},"ts":"1699613615260"} 2023-11-10 10:53:35,265 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-10 10:53:35,266 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:53:35,266 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613615266"}]},"ts":"1699613615266"} 2023-11-10 10:53:35,268 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-10 10:53:35,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d2ce2a7600c83ffbc19dedfaf004b7e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b5388fe6b3c513779c89d7cabf105864, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b908cc77579006daf878d3b2dd1b0a7a, ASSIGN}] 2023-11-10 10:53:35,276 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b5388fe6b3c513779c89d7cabf105864, ASSIGN 2023-11-10 10:53:35,276 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d2ce2a7600c83ffbc19dedfaf004b7e, ASSIGN 2023-11-10 10:53:35,277 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b908cc77579006daf878d3b2dd1b0a7a, ASSIGN 2023-11-10 10:53:35,278 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d2ce2a7600c83ffbc19dedfaf004b7e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:35,278 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b908cc77579006daf878d3b2dd1b0a7a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:35,278 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b5388fe6b3c513779c89d7cabf105864, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-10 10:53:35,431 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b908cc77579006daf878d3b2dd1b0a7a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b5388fe6b3c513779c89d7cabf105864, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,431 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5d2ce2a7600c83ffbc19dedfaf004b7e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,431 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699613615431"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613615431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613615431"}]},"ts":"1699613615431"} 2023-11-10 10:53:35,431 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699613615431"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613615431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613615431"}]},"ts":"1699613615431"} 2023-11-10 10:53:35,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699613615431"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613615431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613615431"}]},"ts":"1699613615431"} 2023-11-10 10:53:35,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure b908cc77579006daf878d3b2dd1b0a7a, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:35,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 5d2ce2a7600c83ffbc19dedfaf004b7e, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:35,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure b5388fe6b3c513779c89d7cabf105864, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:35,551 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/.tmp/family1/a45639cb29764af196ad7e9ae25c9c13 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/a45639cb29764af196ad7e9ae25c9c13 2023-11-10 10:53:35,558 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 967b16d4c017fd910dfe7c1d1ea18d86/family1 of 967b16d4c017fd910dfe7c1d1ea18d86 into a45639cb29764af196ad7e9ae25c9c13(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:35,558 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:53:35,558 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1699613614674; duration=0sec 2023-11-10 10:53:35,558 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:35,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/fc8ef6d388fd4013a644358efd42dd3b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/35edcb47f91d49bb8ac05a03d6eb964f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_] to archive 2023-11-10 10:53:35,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:35,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/fc8ef6d388fd4013a644358efd42dd3b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/fc8ef6d388fd4013a644358efd42dd3b 2023-11-10 10:53:35,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/35edcb47f91d49bb8ac05a03d6eb964f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/35edcb47f91d49bb8ac05a03d6eb964f 2023-11-10 10:53:35,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/family1/5685825dfe4f460a9264b8d69316ae0d_SeqId_47_ 2023-11-10 10:53:35,588 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,591 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b908cc77579006daf878d3b2dd1b0a7a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.', STARTKEY => '2', ENDKEY => ''} 2023-11-10 10:53:35,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:35,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,594 INFO [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,595 DEBUG [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1 2023-11-10 10:53:35,595 DEBUG [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1 2023-11-10 10:53:35,596 INFO [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b908cc77579006daf878d3b2dd1b0a7a columnFamilyName family1 2023-11-10 10:53:35,597 INFO [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] regionserver.HStore(310): Store=b908cc77579006daf878d3b2dd1b0a7a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:35,597 INFO [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,599 DEBUG [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family2 2023-11-10 10:53:35,599 DEBUG [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family2 2023-11-10 10:53:35,599 INFO [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b908cc77579006daf878d3b2dd1b0a7a columnFamilyName family2 2023-11-10 10:53:35,601 INFO [StoreOpener-b908cc77579006daf878d3b2dd1b0a7a-1] regionserver.HStore(310): Store=b908cc77579006daf878d3b2dd1b0a7a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:35,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:53:35,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:53:35,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:35,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b908cc77579006daf878d3b2dd1b0a7a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74277399, jitterRate=0.10681949555873871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:53:35,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:53:35,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a., pid=31, masterSystemTime=1699613615588 2023-11-10 10:53:35,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:35,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d2ce2a7600c83ffbc19dedfaf004b7e, NAME => 'testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.', STARTKEY => '', ENDKEY => '1'} 2023-11-10 10:53:35,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:35,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b908cc77579006daf878d3b2dd1b0a7a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699613615616"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613615616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613615616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613615616"}]},"ts":"1699613615616"} 2023-11-10 10:53:35,618 INFO [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,621 DEBUG [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e/family1 2023-11-10 10:53:35,621 DEBUG [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e/family1 2023-11-10 10:53:35,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=30 2023-11-10 10:53:35,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure b908cc77579006daf878d3b2dd1b0a7a, server=jenkins-hbase20.apache.org,43721,1699613570510 in 185 msec 2023-11-10 10:53:35,622 INFO [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d2ce2a7600c83ffbc19dedfaf004b7e columnFamilyName family1 2023-11-10 10:53:35,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b908cc77579006daf878d3b2dd1b0a7a, ASSIGN in 349 msec 2023-11-10 10:53:35,623 INFO [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] regionserver.HStore(310): Store=5d2ce2a7600c83ffbc19dedfaf004b7e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:35,623 INFO [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,625 DEBUG [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e/family2 2023-11-10 10:53:35,625 DEBUG [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e/family2 2023-11-10 10:53:35,625 INFO [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d2ce2a7600c83ffbc19dedfaf004b7e columnFamilyName family2 2023-11-10 10:53:35,626 INFO [StoreOpener-5d2ce2a7600c83ffbc19dedfaf004b7e-1] regionserver.HStore(310): Store=5d2ce2a7600c83ffbc19dedfaf004b7e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:35,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:53:35,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:53:35,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:35,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5d2ce2a7600c83ffbc19dedfaf004b7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72058973, jitterRate=0.07376237213611603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:53:35,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5d2ce2a7600c83ffbc19dedfaf004b7e: 2023-11-10 10:53:35,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e., pid=32, masterSystemTime=1699613615588 2023-11-10 10:53:35,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:35,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:35,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:35,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5388fe6b3c513779c89d7cabf105864, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.', STARTKEY => '1', ENDKEY => '2'} 2023-11-10 10:53:35,636 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5d2ce2a7600c83ffbc19dedfaf004b7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:35,636 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699613615635"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613615635"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613615635"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613615635"}]},"ts":"1699613615635"} 2023-11-10 10:53:35,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,637 INFO [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,639 DEBUG [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864/family1 2023-11-10 10:53:35,639 DEBUG [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864/family1 2023-11-10 10:53:35,640 INFO [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5388fe6b3c513779c89d7cabf105864 columnFamilyName family1 2023-11-10 10:53:35,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-11-10 10:53:35,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 5d2ce2a7600c83ffbc19dedfaf004b7e, server=jenkins-hbase20.apache.org,43721,1699613570510 in 202 msec 2023-11-10 10:53:35,641 INFO [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] regionserver.HStore(310): Store=b5388fe6b3c513779c89d7cabf105864/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:35,641 INFO [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5d2ce2a7600c83ffbc19dedfaf004b7e, ASSIGN in 367 msec 2023-11-10 10:53:35,642 DEBUG [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864/family2 2023-11-10 10:53:35,642 DEBUG [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864/family2 2023-11-10 10:53:35,643 INFO [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5388fe6b3c513779c89d7cabf105864 columnFamilyName family2 2023-11-10 10:53:35,644 INFO [StoreOpener-b5388fe6b3c513779c89d7cabf105864-1] regionserver.HStore(310): Store=b5388fe6b3c513779c89d7cabf105864/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:35,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:53:35,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:53:35,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:35,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b5388fe6b3c513779c89d7cabf105864; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71687916, jitterRate=0.0682331919670105}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:53:35,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b5388fe6b3c513779c89d7cabf105864: 2023-11-10 10:53:35,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864., pid=33, masterSystemTime=1699613615588 2023-11-10 10:53:35,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:35,652 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:35,653 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=b5388fe6b3c513779c89d7cabf105864, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,653 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699613615653"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613615653"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613615653"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613615653"}]},"ts":"1699613615653"} 2023-11-10 10:53:35,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=29 2023-11-10 10:53:35,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure b5388fe6b3c513779c89d7cabf105864, server=jenkins-hbase20.apache.org,43721,1699613570510 in 217 msec 2023-11-10 10:53:35,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-11-10 10:53:35,658 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b5388fe6b3c513779c89d7cabf105864, ASSIGN in 383 msec 2023-11-10 10:53:35,659 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:53:35,659 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613615659"}]},"ts":"1699613615659"} 2023-11-10 10:53:35,660 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-10 10:53:35,662 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:53:35,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 849 msec 2023-11-10 10:53:35,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-10 10:53:35,925 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-10 10:53:35,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:35,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,943 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-10 10:53:35,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:35,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-10 10:53:35,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-10 10:53:35,944 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,944 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,945 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:35,945 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:35,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:35,946 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,946 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:35,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:35,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:35,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-10 10:53:35,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:35,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-10 10:53:35,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:35,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. started... 2023-11-10 10:53:35,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:53:35,948 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:35,948 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5d2ce2a7600c83ffbc19dedfaf004b7e: 2023-11-10 10:53:35,948 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:35,948 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. started... 2023-11-10 10:53:35,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:35,948 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:35,949 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b908cc77579006daf878d3b2dd1b0a7a 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-10 10:53:35,949 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. started... 2023-11-10 10:53:35,949 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:53:35,950 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b5388fe6b3c513779c89d7cabf105864: 2023-11-10 10:53:35,950 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:35,950 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:53:36,369 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110e05710f7dbc64017931767297fd5fc25 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231110e05710f7dbc64017931767297fd5fc25 2023-11-10 10:53:36,776 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/.tmp/family1/fc78d8509a574fd4b6a98b89e2b07c3c 2023-11-10 10:53:36,784 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/.tmp/family1/fc78d8509a574fd4b6a98b89e2b07c3c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/fc78d8509a574fd4b6a98b89e2b07c3c 2023-11-10 10:53:36,793 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/fc78d8509a574fd4b6a98b89e2b07c3c, entries=1, sequenceid=5, filesize=4.9 K 2023-11-10 10:53:36,794 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for b908cc77579006daf878d3b2dd1b0a7a in 845ms, sequenceid=5, compaction requested=false 2023-11-10 10:53:36,794 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-10 10:53:36,795 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:53:36,795 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:36,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:53:36,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:53:36,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-10 10:53:36,796 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-10 10:53:36,797 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:36,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:36,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-10 10:53:36,800 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bcee59e[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:36,800 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-10 10:53:36,800 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,801 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,801 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-10 10:53:36,801 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-10 10:53:36,801 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,801 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:36,801 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:36,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,802 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-10 10:53:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:36,802 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:36,820 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:53:36,820 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-10 10:53:36,820 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f9305d0 to 127.0.0.1:62972 2023-11-10 10:53:36,820 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:53:36,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:36,821 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:53:36,821 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x176932ad to 127.0.0.1:62972 2023-11-10 10:53:36,821 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:53:36,825 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:53:36,826 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x132a6594 to 127.0.0.1:62972 2023-11-10 10:53:36,826 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:53:36,828 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:53:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:36,828 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x22e4d6de to 127.0.0.1:62972 2023-11-10 10:53:36,828 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:53:36,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:36,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-10 10:53:36,830 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-10 10:53:36,830 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:36,830 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:36,830 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,830 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:36,831 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:36,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:36,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:36,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,833 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:36,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:36,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:36,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,834 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:36,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-10 10:53:36,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:36,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:36,836 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:36,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:36,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,837 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:36,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:36,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:36,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,937 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:36,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:36,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:36,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,947 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-10 10:53:36,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:36,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-10 10:53:36,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-10 10:53:36,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,949 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:36,949 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:36,949 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:36,949 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:36,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,950 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:36,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,950 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,951 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-10 10:53:36,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:36,951 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-10 10:53:36,951 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:36,951 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. started... 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5d2ce2a7600c83ffbc19dedfaf004b7e: 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. started... 2023-11-10 10:53:36,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for b5388fe6b3c513779c89d7cabf105864: 2023-11-10 10:53:36,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. started... 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:53:36,953 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b908cc77579006daf878d3b2dd1b0a7a 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-10 10:53:36,953 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:53:36,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:53:36,953 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:53:37,378 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311100e3097e37388489fa149cd28722ac004 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311100e3097e37388489fa149cd28722ac004 2023-11-10 10:53:37,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/.tmp/family1/511f32a3e96a45748674439f534c2dc8 2023-11-10 10:53:37,792 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/.tmp/family1/511f32a3e96a45748674439f534c2dc8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/511f32a3e96a45748674439f534c2dc8 2023-11-10 10:53:37,796 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/511f32a3e96a45748674439f534c2dc8, entries=2, sequenceid=9, filesize=5.0 K 2023-11-10 10:53:37,797 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for b908cc77579006daf878d3b2dd1b0a7a in 845ms, sequenceid=9, compaction requested=false 2023-11-10 10:53:37,797 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:53:37,797 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:37,797 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:53:37,797 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:53:37,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-10 10:53:37,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-10 10:53:37,799 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,799 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:37,799 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,799 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:37,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:37,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-10 10:53:37,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@569acdb0[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:37,801 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-10 10:53:37,801 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-10 10:53:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-10 10:53:37,802 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:37,802 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,802 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:37,803 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,803 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-10 10:53:37,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:37,803 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:37,804 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-10 10:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:37,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-10 10:53:37,806 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-10 10:53:37,806 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:37,806 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:37,806 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,806 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:37,816 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,816 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,817 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,816 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:37,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:37,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:37,818 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:37,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:37,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-10 10:53:37,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:37,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:37,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:37,832 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:37,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:37,832 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:37,833 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-10 10:53:37,833 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:37,833 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,833 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,833 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,933 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:37,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:37,940 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-10 10:53:37,942 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-10 10:53:37,942 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-10 10:53:37,943 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:37,943 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614217943 2023-11-10 10:53:37,944 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:53:37,944 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-10 10:53:37,945 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-10 10:53:37,946 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x569b30a8 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:37,950 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fbf2a57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:37,950 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231110 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-10 10:53:38,780 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110163174b214a742baa99f948ddd7b2e5d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231110163174b214a742baa99f948ddd7b2e5d 2023-11-10 10:53:38,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-10 10:53:38,797 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:53:38,798 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:53:38,806 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:53:38,808 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:53:38,822 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231110/family1/c479f9355d2242139866297c0bb029e4 first=Optional[k0] last=Optional[k1] 2023-11-10 10:53:38,823 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231110/family1/c479f9355d2242139866297c0bb029e4}] 2023-11-10 10:53:38,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231110/family1/c479f9355d2242139866297c0bb029e4 for inclusion in b908cc77579006daf878d3b2dd1b0a7a/family1 2023-11-10 10:53:38,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-10 10:53:38,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-10 10:53:38,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:53:38,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231110/family1/c479f9355d2242139866297c0bb029e4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testScannerOnBulkLoadRefHFiles__vev6sdg11cl5tp3nrhih8gbrdfkuc11g9msm5ruep9h7nogk6hji57sofdu2vgdo/family1/c479f9355d2242139866297c0bb029e4 2023-11-10 10:53:38,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testScannerOnBulkLoadRefHFiles__vev6sdg11cl5tp3nrhih8gbrdfkuc11g9msm5ruep9h7nogk6hji57sofdu2vgdo/family1/c479f9355d2242139866297c0bb029e4 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_ 2023-11-10 10:53:38,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testScannerOnBulkLoadRefHFiles__vev6sdg11cl5tp3nrhih8gbrdfkuc11g9msm5ruep9h7nogk6hji57sofdu2vgdo/family1/c479f9355d2242139866297c0bb029e4 into b908cc77579006daf878d3b2dd1b0a7a/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_ - updating store file list. 2023-11-10 10:53:38,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_ into b908cc77579006daf878d3b2dd1b0a7a/family1 2023-11-10 10:53:38,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testScannerOnBulkLoadRefHFiles__vev6sdg11cl5tp3nrhih8gbrdfkuc11g9msm5ruep9h7nogk6hji57sofdu2vgdo/family1/c479f9355d2242139866297c0bb029e4 into b908cc77579006daf878d3b2dd1b0a7a/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_) 2023-11-10 10:53:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testScannerOnBulkLoadRefHFiles__vev6sdg11cl5tp3nrhih8gbrdfkuc11g9msm5ruep9h7nogk6hji57sofdu2vgdo/family1/c479f9355d2242139866297c0bb029e4 2023-11-10 10:53:38,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:53:38,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:53:38,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): b908cc77579006daf878d3b2dd1b0a7a/family1 is initiating minor compaction (all files) 2023-11-10 10:53:38,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@14b2994a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:38,842 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b908cc77579006daf878d3b2dd1b0a7a/family1 in testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:53:38,842 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/fc78d8509a574fd4b6a98b89e2b07c3c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/511f32a3e96a45748674439f534c2dc8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/.tmp, totalSize=15.1 K 2023-11-10 10:53:38,843 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting fc78d8509a574fd4b6a98b89e2b07c3c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613615926 2023-11-10 10:53:38,843 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 511f32a3e96a45748674439f534c2dc8, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613615926 2023-11-10 10:53:38,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-10 10:53:38,844 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 1e0377f2775f469dad37672e8a2e522a_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613615926 2023-11-10 10:53:38,845 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:38,847 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311100e3097e37388489fa149cd28722ac004 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311100e3097e37388489fa149cd28722ac004 2023-11-10 10:53:38,848 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231110e05710f7dbc64017931767297fd5fc25 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231110e05710f7dbc64017931767297fd5fc25 2023-11-10 10:53:38,848 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-10 10:53:38,848 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231110' 2023-11-10 10:53:38,849 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231110 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-10 10:53:38,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-10 10:53:38,849 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:38,850 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-10 10:53:38,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 909 msec 2023-11-10 10:53:38,856 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): b908cc77579006daf878d3b2dd1b0a7a#family1#compaction#38 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:38,891 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=251 (was 263), OpenFileDescriptor=625 (was 648), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=219 (was 219), ProcessCount=166 (was 166), AvailableMemoryMB=9399 (was 8415) - AvailableMemoryMB LEAK? - 2023-11-10 10:53:38,907 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251, OpenFileDescriptor=625, MaxFileDescriptor=60000, SystemLoadAverage=219, ProcessCount=166, AvailableMemoryMB=9396 2023-11-10 10:53:38,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-10 10:53:38,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:38,912 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:53:38,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-10 10:53:38,913 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:53:38,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-10 10:53:38,914 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:38,915 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a empty. 2023-11-10 10:53:38,915 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:38,916 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-10 10:53:38,924 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-10 10:53:38,925 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 620ce06af7c5c692d21991e92530ba9a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:38,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:38,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 620ce06af7c5c692d21991e92530ba9a, disabling compactions & flushes 2023-11-10 10:53:38,932 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:38,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:38,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. after waiting 0 ms 2023-11-10 10:53:38,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:38,932 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:38,932 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:38,935 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:53:38,936 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699613618936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613618936"}]},"ts":"1699613618936"} 2023-11-10 10:53:38,937 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:53:38,938 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:53:38,938 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613618938"}]},"ts":"1699613618938"} 2023-11-10 10:53:38,940 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-10 10:53:38,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=620ce06af7c5c692d21991e92530ba9a, ASSIGN}] 2023-11-10 10:53:38,945 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=620ce06af7c5c692d21991e92530ba9a, ASSIGN 2023-11-10 10:53:38,946 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=620ce06af7c5c692d21991e92530ba9a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:39,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-10 10:53:39,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=620ce06af7c5c692d21991e92530ba9a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:39,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699613619097"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613619097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613619097"}]},"ts":"1699613619097"} 2023-11-10 10:53:39,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 620ce06af7c5c692d21991e92530ba9a, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:39,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-10 10:53:39,251 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:39,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:39,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 620ce06af7c5c692d21991e92530ba9a, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:53:39,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:39,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,258 INFO [StoreOpener-620ce06af7c5c692d21991e92530ba9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,259 DEBUG [StoreOpener-620ce06af7c5c692d21991e92530ba9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1 2023-11-10 10:53:39,260 DEBUG [StoreOpener-620ce06af7c5c692d21991e92530ba9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1 2023-11-10 10:53:39,260 INFO [StoreOpener-620ce06af7c5c692d21991e92530ba9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 620ce06af7c5c692d21991e92530ba9a columnFamilyName family1 2023-11-10 10:53:39,262 INFO [StoreOpener-620ce06af7c5c692d21991e92530ba9a-1] regionserver.HStore(310): Store=620ce06af7c5c692d21991e92530ba9a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:39,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:53:39,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:39,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 620ce06af7c5c692d21991e92530ba9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68007586, jitterRate=0.013392001390457153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:53:39,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:39,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a., pid=37, masterSystemTime=1699613619251 2023-11-10 10:53:39,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:39,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:39,272 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=620ce06af7c5c692d21991e92530ba9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:39,272 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699613619272"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613619272"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613619272"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613619272"}]},"ts":"1699613619272"} 2023-11-10 10:53:39,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-10 10:53:39,276 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 620ce06af7c5c692d21991e92530ba9a, server=jenkins-hbase20.apache.org,43721,1699613570510 in 175 msec 2023-11-10 10:53:39,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-10 10:53:39,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=620ce06af7c5c692d21991e92530ba9a, ASSIGN in 333 msec 2023-11-10 10:53:39,279 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:53:39,279 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613619279"}]},"ts":"1699613619279"} 2023-11-10 10:53:39,281 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-10 10:53:39,283 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:53:39,286 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 374 msec 2023-11-10 10:53:39,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-10 10:53:39,517 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-10 10:53:39,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:39,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,549 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:39,549 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:39,549 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:39,549 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:39,549 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,549 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,550 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:39,550 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:39,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:39,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:39,551 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:39,551 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:39,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:39,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,551 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:39,552 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:39,557 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:39,557 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:39,557 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:39,557 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:39,558 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:53:39,697 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/.tmp/family1/8ca26d09b9934957a6c6a02088288684 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/8ca26d09b9934957a6c6a02088288684 2023-11-10 10:53:39,703 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b908cc77579006daf878d3b2dd1b0a7a/family1 of b908cc77579006daf878d3b2dd1b0a7a into 8ca26d09b9934957a6c6a02088288684(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:39,703 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:53:39,703 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699613618842; duration=0sec 2023-11-10 10:53:39,703 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:39,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/fc78d8509a574fd4b6a98b89e2b07c3c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/511f32a3e96a45748674439f534c2dc8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_] to archive 2023-11-10 10:53:39,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:39,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/fc78d8509a574fd4b6a98b89e2b07c3c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/fc78d8509a574fd4b6a98b89e2b07c3c 2023-11-10 10:53:39,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/511f32a3e96a45748674439f534c2dc8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/511f32a3e96a45748674439f534c2dc8 2023-11-10 10:53:39,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/family1/1e0377f2775f469dad37672e8a2e522a_SeqId_12_ 2023-11-10 10:53:39,978 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e666f800f4b34b7fb04d3920d8542ac9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130e666f800f4b34b7fb04d3920d8542ac9 2023-11-10 10:53:40,377 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:40,383 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/1826cbefd6c94e42818d1ee397b56a75 2023-11-10 10:53:40,388 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/1826cbefd6c94e42818d1ee397b56a75 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/1826cbefd6c94e42818d1ee397b56a75 2023-11-10 10:53:40,393 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/1826cbefd6c94e42818d1ee397b56a75, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-10 10:53:40,394 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 835ms, sequenceid=5, compaction requested=false 2023-11-10 10:53:40,394 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:40,394 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:40,394 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:40,394 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:40,394 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,394 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:40,394 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:40,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,396 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:40,396 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:40,396 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:40,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:40,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75a95d8e[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:40,398 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:40,398 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,398 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,399 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:40,399 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:40,399 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:40,399 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,399 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:40,400 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,400 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:40,400 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:40,400 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:40,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:40,402 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:40,402 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:40,402 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:40,402 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,402 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:40,403 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:40,403 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,404 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:40,404 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:40,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,405 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:40,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:40,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:40,407 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:40,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:40,408 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:40,407 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,408 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:40,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:40,408 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:40,508 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:40,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:40,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:40,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:40,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,516 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:40,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:40,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:40,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:40,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,516 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,517 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:40,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:40,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:40,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,518 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,518 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:40,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:40,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:40,519 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:40,519 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:40,519 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:40,519 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:40,519 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:40,519 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:53:40,532 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283460932e696d4b48a7ca63128d860631 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511283460932e696d4b48a7ca63128d860631 2023-11-10 10:53:40,940 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/910737e6d4e64419aad10366f727833b 2023-11-10 10:53:40,946 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/910737e6d4e64419aad10366f727833b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/910737e6d4e64419aad10366f727833b 2023-11-10 10:53:40,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/910737e6d4e64419aad10366f727833b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:53:40,952 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 433ms, sequenceid=9, compaction requested=false 2023-11-10 10:53:40,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:40,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:40,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:40,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:40,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:40,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:40,953 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,953 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:40,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:40,954 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:40,954 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:40,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:40,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:40,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a6b0784[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:40,955 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:40,956 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,956 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,957 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:40,957 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:40,957 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:40,957 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,957 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:40,958 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:40,958 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:40,958 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:40,958 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:40,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:40,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:40,961 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:40,961 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:40,961 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:40,961 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,961 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:40,962 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,962 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:40,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:40,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:40,963 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:40,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:40,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,965 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:40,969 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:40,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:40,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:40,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:40,969 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:40,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:41,069 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:41,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:41,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:41,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:41,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,076 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:41,076 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:41,076 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:41,076 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:41,077 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,077 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,078 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,078 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:41,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:41,078 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,079 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:41,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:41,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:41,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:41,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:41,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:41,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:41,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:41,080 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:41,080 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:41,080 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:41,097 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011a3dccdea794405b98afd4af7e5e65d5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011a3dccdea794405b98afd4af7e5e65d5 2023-11-10 10:53:41,119 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:53:41,508 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f 2023-11-10 10:53:41,514 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f 2023-11-10 10:53:41,518 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f, entries=1, sequenceid=13, filesize=4.9 K 2023-11-10 10:53:41,519 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 439ms, sequenceid=13, compaction requested=true 2023-11-10 10:53:41,519 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:41,519 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:41,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:41,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:41,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:41,520 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:41,521 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,521 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:41,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:41,522 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:41,522 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:41,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:41,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:41,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5645e342[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:41,523 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:41,523 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,524 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,524 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:41,524 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:41,524 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:41,524 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,524 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:41,525 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:41,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,525 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:41,525 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:41,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:41,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:41,527 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:41,527 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:41,527 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:41,527 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:41,527 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,527 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:41,529 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,529 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:41,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,529 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:41,529 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:41,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,531 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:41,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:41,533 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:41,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:41,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:41,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:41,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:41,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:41,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:41,533 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:41,533 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:41,633 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:41,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:41,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:41,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:41,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,641 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:41,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:41,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:41,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:41,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,642 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:41,642 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:41,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:41,643 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,643 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:41,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:41,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,643 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,644 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:41,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:41,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:41,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:41,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:41,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:41,644 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:41,644 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:41,644 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:41,644 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:42,057 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058b25c5a02aa54269bacb79b374e0576c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058b25c5a02aa54269bacb79b374e0576c 2023-11-10 10:53:42,464 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/fc4b74e22e984de7979c726340785527 2023-11-10 10:53:42,475 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/fc4b74e22e984de7979c726340785527 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/fc4b74e22e984de7979c726340785527 2023-11-10 10:53:42,480 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/fc4b74e22e984de7979c726340785527, entries=1, sequenceid=17, filesize=4.9 K 2023-11-10 10:53:42,481 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 836ms, sequenceid=17, compaction requested=true 2023-11-10 10:53:42,481 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:42,481 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:42,481 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:42,481 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:42,481 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,481 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:42,481 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:42,482 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,482 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:42,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:42,482 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,483 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:42,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:42,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56325377[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:42,484 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:42,484 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,485 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,485 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:42,485 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:42,485 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,485 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:42,485 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:42,486 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:42,486 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:42,486 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:42,486 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:42,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:42,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:42,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:42,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:42,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:42,488 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:42,488 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:42,488 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:42,488 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,488 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:42,490 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,490 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:42,490 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:42,490 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:42,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:42,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,495 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:42,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:42,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:42,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:42,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:42,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:42,497 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:42,497 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:42,498 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:42,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:42,498 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,498 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,598 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:42,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:42,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:42,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:42,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,604 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:42,604 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:42,604 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:42,604 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:42,605 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,605 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,606 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:42,606 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:42,606 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:42,607 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,607 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,608 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:42,608 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:42,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:42,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:42,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:42,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:42,608 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:42,608 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:42,608 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:42,608 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:43,024 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122822a245923ae4420f80a6fea5669f86c6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122822a245923ae4420f80a6fea5669f86c6 2023-11-10 10:53:43,430 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/d96c508666be42219281c59fce4aafc0 2023-11-10 10:53:43,437 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/d96c508666be42219281c59fce4aafc0 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/d96c508666be42219281c59fce4aafc0 2023-11-10 10:53:43,442 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/d96c508666be42219281c59fce4aafc0, entries=1, sequenceid=21, filesize=4.9 K 2023-11-10 10:53:43,443 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 835ms, sequenceid=21, compaction requested=true 2023-11-10 10:53:43,443 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:43,443 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:43,443 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:43,443 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:43,443 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,443 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:43,443 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:43,444 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,444 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:43,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:43,445 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,445 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:43,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:43,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:43,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:43,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:43,446 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69c82112[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:43,446 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:43,446 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,447 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,447 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:43,447 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:43,447 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:43,448 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,448 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:43,450 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,450 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:43,450 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:43,450 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:43,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:43,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:43,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:43,452 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:43,452 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:43,452 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:43,452 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,452 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:43,453 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,454 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:43,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,454 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:43,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:43,454 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,455 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:43,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:43,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:43,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:43,457 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:43,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:43,457 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:43,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:43,557 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:43,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:43,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:43,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:43,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,565 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:43,565 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:43,565 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:43,565 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:43,565 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,565 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,566 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:43,566 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:43,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:43,567 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:43,567 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:43,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,567 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:43,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,568 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,568 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:43,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:43,568 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:43,568 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:43,568 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:43,568 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:43,568 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:43,569 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:43,569 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:43,569 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:43,581 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123135b3fecd855449568febdfb7bcecb085 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123135b3fecd855449568febdfb7bcecb085 2023-11-10 10:53:43,988 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/974c87e4f45d485cb91cf2c1081cb137 2023-11-10 10:53:43,994 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/974c87e4f45d485cb91cf2c1081cb137 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/974c87e4f45d485cb91cf2c1081cb137 2023-11-10 10:53:43,999 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/974c87e4f45d485cb91cf2c1081cb137, entries=1, sequenceid=25, filesize=4.9 K 2023-11-10 10:53:44,000 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 431ms, sequenceid=25, compaction requested=true 2023-11-10 10:53:44,000 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:44,000 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:44,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:44,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:44,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:44,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:44,002 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,002 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:44,002 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,002 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:44,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:44,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:44,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b5d5c88[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:44,004 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:44,004 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,005 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,005 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:44,005 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:44,005 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:44,005 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,006 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:44,007 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,007 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:44,007 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:44,007 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:44,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:44,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:44,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:44,010 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:44,010 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:44,010 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:44,010 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,010 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:44,015 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,015 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:44,015 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,015 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:44,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:44,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,016 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,018 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:44,018 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:44,018 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:44,018 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:44,018 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:44,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:44,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:44,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:44,018 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,019 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,019 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,019 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,019 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,019 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:44,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:44,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:44,019 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:44,119 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:44,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:44,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:44,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:44,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,127 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:44,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:44,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:44,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:44,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,128 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:44,129 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:44,129 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,129 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:44,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,130 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,130 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:44,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:44,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:44,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:44,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:44,131 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:44,131 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:44,131 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:44,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:44,549 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010116de5ad13a3548ea82d37f6a9d93c358 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010116de5ad13a3548ea82d37f6a9d93c358 2023-11-10 10:53:44,556 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/050fde6e4d4d4368924b2b357fa4f79c 2023-11-10 10:53:44,564 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/050fde6e4d4d4368924b2b357fa4f79c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/050fde6e4d4d4368924b2b357fa4f79c 2023-11-10 10:53:44,572 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/050fde6e4d4d4368924b2b357fa4f79c, entries=1, sequenceid=29, filesize=4.9 K 2023-11-10 10:53:44,573 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 442ms, sequenceid=29, compaction requested=true 2023-11-10 10:53:44,573 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:44,573 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:44,573 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:44,573 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:44,573 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,573 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:44,574 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:44,575 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,575 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,576 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:44,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:44,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:44,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:44,579 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527be552[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:44,579 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:44,579 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,580 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,580 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:44,580 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:44,580 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:44,580 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,580 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:44,581 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:44,581 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,582 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:44,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:44,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:44,582 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:44,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:44,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:44,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:44,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:44,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:44,586 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:44,586 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:44,586 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:44,586 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,586 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:44,591 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,591 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:44,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,591 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:44,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:44,592 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,594 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,599 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,599 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,599 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:44,599 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:44,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:44,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:44,599 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:44,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:44,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:44,599 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:44,600 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,600 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,600 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,600 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,600 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:44,600 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:44,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:44,700 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:44,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:44,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:44,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:44,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,706 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:44,706 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:44,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:44,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:44,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,708 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:44,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:44,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:44,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:44,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:44,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:44,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,709 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:44,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:44,709 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:44,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:44,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:44,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:44,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:44,710 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:44,710 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:44,710 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:45,126 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039e44d398ce5f4d60b9f8f774e93ad1d6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601039e44d398ce5f4d60b9f8f774e93ad1d6 2023-11-10 10:53:45,532 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/3361808cd6fd45bea17ce9b41fffc4e6 2023-11-10 10:53:45,542 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/3361808cd6fd45bea17ce9b41fffc4e6 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/3361808cd6fd45bea17ce9b41fffc4e6 2023-11-10 10:53:45,547 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/3361808cd6fd45bea17ce9b41fffc4e6, entries=1, sequenceid=33, filesize=4.9 K 2023-11-10 10:53:45,547 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 837ms, sequenceid=33, compaction requested=true 2023-11-10 10:53:45,548 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:45,548 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:45,548 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:45,548 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:45,548 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,548 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:45,548 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:45,550 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,550 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:45,551 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,551 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:45,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:45,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1696bd81[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:45,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:45,552 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,553 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,553 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:45,553 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:45,553 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:45,553 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,553 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:45,554 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:45,554 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,554 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:45,554 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:45,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:45,556 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:45,556 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:45,556 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:45,556 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,557 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:45,557 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,557 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:45,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,557 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:45,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:45,558 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,559 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:45,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,560 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:45,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:45,561 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:45,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:45,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:45,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:45,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:45,561 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,661 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:45,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:45,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:45,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:45,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,668 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:45,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:45,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:45,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:45,669 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,669 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,670 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:45,670 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:45,670 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:45,670 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,671 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,671 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:45,671 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:45,671 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:45,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:45,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:45,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:45,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:45,672 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:45,672 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:45,672 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:46,088 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077f9a9c3b81a44799b1047bc24f112b3f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509077f9a9c3b81a44799b1047bc24f112b3f 2023-11-10 10:53:46,496 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/da6311e0083442dd8241ed093c7c8752 2023-11-10 10:53:46,504 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/da6311e0083442dd8241ed093c7c8752 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/da6311e0083442dd8241ed093c7c8752 2023-11-10 10:53:46,510 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/da6311e0083442dd8241ed093c7c8752, entries=1, sequenceid=37, filesize=4.9 K 2023-11-10 10:53:46,511 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 839ms, sequenceid=37, compaction requested=true 2023-11-10 10:53:46,511 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:46,511 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:46,511 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:46,511 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:46,511 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,511 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:46,511 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:46,512 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,513 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:46,513 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,513 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:46,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:46,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e7edef0[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:46,514 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:46,514 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,515 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:46,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:46,515 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:46,515 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,515 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:46,516 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,516 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:46,516 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:46,516 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:46,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:46,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:46,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:46,518 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:46,518 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:46,518 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:46,518 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,518 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:46,520 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,520 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:46,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,520 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:46,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:46,520 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,521 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:46,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,522 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,522 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:46,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:46,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:46,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:46,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:46,523 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:46,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:46,523 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:46,623 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:46,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:46,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:46,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:46,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,635 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:46,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:46,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-10 10:53:46,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-10 10:53:46,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,637 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,638 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,638 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:46,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:46,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:46,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:46,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:46,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,641 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,641 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-10 10:53:46,641 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:46,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-10 10:53:46,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:46,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-10 10:53:46,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:46,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:46,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:46,642 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. started... 2023-11-10 10:53:46,642 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 620ce06af7c5c692d21991e92530ba9a 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:46,664 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e9d5f7508dcc427dbf917fd8f8fe89b8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120e9d5f7508dcc427dbf917fd8f8fe89b8 2023-11-10 10:53:47,074 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/b4303b211e5447758928706a07f8b0cc 2023-11-10 10:53:47,079 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/b4303b211e5447758928706a07f8b0cc as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/b4303b211e5447758928706a07f8b0cc 2023-11-10 10:53:47,084 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/b4303b211e5447758928706a07f8b0cc, entries=1, sequenceid=41, filesize=4.9 K 2023-11-10 10:53:47,085 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 620ce06af7c5c692d21991e92530ba9a in 443ms, sequenceid=41, compaction requested=true 2023-11-10 10:53:47,085 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:47,085 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:47,085 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:47,085 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:47,085 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,085 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-10 10:53:47,085 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-10 10:53:47,087 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:47,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:47,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:47,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-10 10:53:47,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f866cab[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:47,089 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-10 10:53:47,089 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,089 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,090 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-10 10:53:47,090 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-10 10:53:47,090 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:47,090 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,090 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:47,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-10 10:53:47,094 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:47,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:47,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:47,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-10 10:53:47,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:47,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:47,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:47,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:47,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:53:47,097 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-10 10:53:47,097 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:47,097 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:47,097 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,097 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:47,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,107 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:47,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:47,108 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,109 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,117 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:47,118 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:47,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:47,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-10 10:53:47,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:47,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:47,118 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,219 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:47,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:47,221 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-10 10:53:47,222 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:47,223 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:47,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:47,224 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614227224 2023-11-10 10:53:47,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:53:47,226 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-10 10:53:47,226 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:47,228 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x1c64a131 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:47,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a7fdd78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:47,231 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,075 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035c481834a10d4b7ea0ddb326126a3851 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601035c481834a10d4b7ea0ddb326126a3851 2023-11-10 10:53:48,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:48,088 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:53:48,089 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:53:48,096 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:53:48,097 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:53:48,107 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0463c31d845f49fc8689055d475adcdd first=Optional[r3] last=Optional[r6] 2023-11-10 10:53:48,108 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0463c31d845f49fc8689055d475adcdd}] 2023-11-10 10:53:48,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0463c31d845f49fc8689055d475adcdd for inclusion in 620ce06af7c5c692d21991e92530ba9a/family1 2023-11-10 10:53:48,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-10 10:53:48,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:48,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:48,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0463c31d845f49fc8689055d475adcdd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4k7b1sskid0t1ikcada9dpu3rsjqsr749tp57jlh7l9f76h2q8483uc8ak4lje2v/family1/0463c31d845f49fc8689055d475adcdd 2023-11-10 10:53:48,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4k7b1sskid0t1ikcada9dpu3rsjqsr749tp57jlh7l9f76h2q8483uc8ak4lje2v/family1/0463c31d845f49fc8689055d475adcdd as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_ 2023-11-10 10:53:48,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4k7b1sskid0t1ikcada9dpu3rsjqsr749tp57jlh7l9f76h2q8483uc8ak4lje2v/family1/0463c31d845f49fc8689055d475adcdd into 620ce06af7c5c692d21991e92530ba9a/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_ - updating store file list. 2023-11-10 10:53:48,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_ into 620ce06af7c5c692d21991e92530ba9a/family1 2023-11-10 10:53:48,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4k7b1sskid0t1ikcada9dpu3rsjqsr749tp57jlh7l9f76h2q8483uc8ak4lje2v/family1/0463c31d845f49fc8689055d475adcdd into 620ce06af7c5c692d21991e92530ba9a/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_) 2023-11-10 10:53:48,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__4k7b1sskid0t1ikcada9dpu3rsjqsr749tp57jlh7l9f76h2q8483uc8ak4lje2v/family1/0463c31d845f49fc8689055d475adcdd 2023-11-10 10:53:48,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:53:48,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:53:48,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 620ce06af7c5c692d21991e92530ba9a/family1 is initiating minor compaction 2023-11-10 10:53:48,132 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 620ce06af7c5c692d21991e92530ba9a/family1 in testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:48,132 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/910737e6d4e64419aad10366f727833b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/fc4b74e22e984de7979c726340785527, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/d96c508666be42219281c59fce4aafc0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/974c87e4f45d485cb91cf2c1081cb137, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/050fde6e4d4d4368924b2b357fa4f79c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/3361808cd6fd45bea17ce9b41fffc4e6, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/da6311e0083442dd8241ed093c7c8752, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/b4303b211e5447758928706a07f8b0cc, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp, totalSize=50.0 K 2023-11-10 10:53:48,132 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 910737e6d4e64419aad10366f727833b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:53:48,132 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 52f1d6d0493b4bf5a13b97d5bf5fbe5f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting fc4b74e22e984de7979c726340785527, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting d96c508666be42219281c59fce4aafc0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 974c87e4f45d485cb91cf2c1081cb137, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 050fde6e4d4d4368924b2b357fa4f79c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 3361808cd6fd45bea17ce9b41fffc4e6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting da6311e0083442dd8241ed093c7c8752, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting b4303b211e5447758928706a07f8b0cc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:53:48,133 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:53:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7c9aef90; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:48,136 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:48,137 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:48,140 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122822a245923ae4420f80a6fea5669f86c6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122822a245923ae4420f80a6fea5669f86c6 2023-11-10 10:53:48,142 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123135b3fecd855449568febdfb7bcecb085 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123135b3fecd855449568febdfb7bcecb085 2023-11-10 10:53:48,143 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010116de5ad13a3548ea82d37f6a9d93c358 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010116de5ad13a3548ea82d37f6a9d93c358 2023-11-10 10:53:48,144 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601039e44d398ce5f4d60b9f8f774e93ad1d6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601039e44d398ce5f4d60b9f8f774e93ad1d6 2023-11-10 10:53:48,144 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-10 10:53:48,144 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,145 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:48,180 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 620ce06af7c5c692d21991e92530ba9a#family1#compaction#49 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:48,630 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/2007b7892f0d4fa6bea396782879d96c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/2007b7892f0d4fa6bea396782879d96c 2023-11-10 10:53:48,635 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 620ce06af7c5c692d21991e92530ba9a/family1 of 620ce06af7c5c692d21991e92530ba9a into 2007b7892f0d4fa6bea396782879d96c(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:53:48,635 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:48,636 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699613628132; duration=0sec 2023-11-10 10:53:48,636 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:48,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/910737e6d4e64419aad10366f727833b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/fc4b74e22e984de7979c726340785527, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/d96c508666be42219281c59fce4aafc0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/974c87e4f45d485cb91cf2c1081cb137, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/050fde6e4d4d4368924b2b357fa4f79c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/3361808cd6fd45bea17ce9b41fffc4e6, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/da6311e0083442dd8241ed093c7c8752, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/b4303b211e5447758928706a07f8b0cc, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_] to archive 2023-11-10 10:53:48,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:48,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/910737e6d4e64419aad10366f727833b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/910737e6d4e64419aad10366f727833b 2023-11-10 10:53:48,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/52f1d6d0493b4bf5a13b97d5bf5fbe5f 2023-11-10 10:53:48,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/fc4b74e22e984de7979c726340785527 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/fc4b74e22e984de7979c726340785527 2023-11-10 10:53:48,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/d96c508666be42219281c59fce4aafc0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/d96c508666be42219281c59fce4aafc0 2023-11-10 10:53:48,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/974c87e4f45d485cb91cf2c1081cb137 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/974c87e4f45d485cb91cf2c1081cb137 2023-11-10 10:53:48,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/050fde6e4d4d4368924b2b357fa4f79c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/050fde6e4d4d4368924b2b357fa4f79c 2023-11-10 10:53:48,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/3361808cd6fd45bea17ce9b41fffc4e6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/3361808cd6fd45bea17ce9b41fffc4e6 2023-11-10 10:53:48,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/da6311e0083442dd8241ed093c7c8752 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/da6311e0083442dd8241ed093c7c8752 2023-11-10 10:53:48,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/b4303b211e5447758928706a07f8b0cc to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/b4303b211e5447758928706a07f8b0cc 2023-11-10 10:53:48,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/404fc6f85a3b4bae8261344dcbf664ba_SeqId_44_ 2023-11-10 10:53:49,050 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055d571003ee294657847b90ee7a7e3950 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055d571003ee294657847b90ee7a7e3950 2023-11-10 10:53:49,051 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:49,073 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f15399274b324ebc927dc2902e0db7c2 first=Optional[r00] last=Optional[r2] 2023-11-10 10:53:49,074 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f15399274b324ebc927dc2902e0db7c2}] 2023-11-10 10:53:49,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f15399274b324ebc927dc2902e0db7c2 for inclusion in 620ce06af7c5c692d21991e92530ba9a/family1 2023-11-10 10:53:49,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-10 10:53:49,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:53:49,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:49,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f15399274b324ebc927dc2902e0db7c2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3pgkqs4k0ebtqt17p2q9q4930sg8ja9bk199esn3e3jcbt8v4lc0d4ml84c2rntv/family1/f15399274b324ebc927dc2902e0db7c2 2023-11-10 10:53:49,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3pgkqs4k0ebtqt17p2q9q4930sg8ja9bk199esn3e3jcbt8v4lc0d4ml84c2rntv/family1/f15399274b324ebc927dc2902e0db7c2 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_ 2023-11-10 10:53:49,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3pgkqs4k0ebtqt17p2q9q4930sg8ja9bk199esn3e3jcbt8v4lc0d4ml84c2rntv/family1/f15399274b324ebc927dc2902e0db7c2 into 620ce06af7c5c692d21991e92530ba9a/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_ - updating store file list. 2023-11-10 10:53:49,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_ into 620ce06af7c5c692d21991e92530ba9a/family1 2023-11-10 10:53:49,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3pgkqs4k0ebtqt17p2q9q4930sg8ja9bk199esn3e3jcbt8v4lc0d4ml84c2rntv/family1/f15399274b324ebc927dc2902e0db7c2 into 620ce06af7c5c692d21991e92530ba9a/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_) 2023-11-10 10:53:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3pgkqs4k0ebtqt17p2q9q4930sg8ja9bk199esn3e3jcbt8v4lc0d4ml84c2rntv/family1/f15399274b324ebc927dc2902e0db7c2 2023-11-10 10:53:49,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:53:49,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:53:49,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 620ce06af7c5c692d21991e92530ba9a/family1 is initiating minor compaction (all files) 2023-11-10 10:53:49,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1b31fc36; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:49,094 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 620ce06af7c5c692d21991e92530ba9a/family1 in testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:53:49,094 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/1826cbefd6c94e42818d1ee397b56a75, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/2007b7892f0d4fa6bea396782879d96c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp, totalSize=337.0 K 2023-11-10 10:53:49,095 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 1826cbefd6c94e42818d1ee397b56a75, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:53:49,095 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 2007b7892f0d4fa6bea396782879d96c, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:53:49,096 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 32c57a51e3f242df805cb402e0f2cfba_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878854600 2023-11-10 10:53:49,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:49,097 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:49,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130e666f800f4b34b7fb04d3920d8542ac9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130e666f800f4b34b7fb04d3920d8542ac9 2023-11-10 10:53:49,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011a3dccdea794405b98afd4af7e5e65d5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011a3dccdea794405b98afd4af7e5e65d5 2023-11-10 10:53:49,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058b25c5a02aa54269bacb79b374e0576c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512058b25c5a02aa54269bacb79b374e0576c 2023-11-10 10:53:49,101 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-10 10:53:49,101 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-10 10:53:49,101 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-10 10:53:49,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-10 10:53:49,101 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:49,102 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:53:49,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8810 sec 2023-11-10 10:53:49,112 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 620ce06af7c5c692d21991e92530ba9a#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:53:49,197 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=258 (was 251) - Thread LEAK? -, OpenFileDescriptor=646 (was 625) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 219) - SystemLoadAverage LEAK? -, ProcessCount=166 (was 166), AvailableMemoryMB=9288 (was 9396) 2023-11-10 10:53:49,208 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=258, OpenFileDescriptor=646, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=166, AvailableMemoryMB=9287 2023-11-10 10:53:49,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-10 10:53:49,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:49,213 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:53:49,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-10 10:53:49,214 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:53:49,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-10 10:53:49,215 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:49,216 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 empty. 2023-11-10 10:53:49,216 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:49,216 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-10 10:53:49,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-10 10:53:49,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-10 10:53:49,626 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-10 10:53:49,628 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7952c1ffcb36612cf85086c22e3b6bd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:53:49,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-10 10:53:50,034 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:50,034 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 7952c1ffcb36612cf85086c22e3b6bd1, disabling compactions & flushes 2023-11-10 10:53:50,034 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,034 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,034 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. after waiting 0 ms 2023-11-10 10:53:50,034 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,034 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,034 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:50,037 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:53:50,038 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613630038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613630038"}]},"ts":"1699613630038"} 2023-11-10 10:53:50,039 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:53:50,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:53:50,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613630041"}]},"ts":"1699613630041"} 2023-11-10 10:53:50,042 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-10 10:53:50,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, ASSIGN}] 2023-11-10 10:53:50,047 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, ASSIGN 2023-11-10 10:53:50,048 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:53:50,199 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:50,199 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613630199"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613630199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613630199"}]},"ts":"1699613630199"} 2023-11-10 10:53:50,201 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:53:50,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-10 10:53:50,331 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/.tmp/family1/cce7d1057fe545a6ad99fdb1f8ac1703 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/cce7d1057fe545a6ad99fdb1f8ac1703 2023-11-10 10:53:50,337 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 620ce06af7c5c692d21991e92530ba9a/family1 of 620ce06af7c5c692d21991e92530ba9a into cce7d1057fe545a6ad99fdb1f8ac1703(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:53:50,338 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:53:50,338 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1699613629094; duration=1sec 2023-11-10 10:53:50,338 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:53:50,353 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:50,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7952c1ffcb36612cf85086c22e3b6bd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:53:50,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:53:50,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,358 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,359 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:53:50,359 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:53:50,359 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7952c1ffcb36612cf85086c22e3b6bd1 columnFamilyName family1 2023-11-10 10:53:50,361 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(310): Store=7952c1ffcb36612cf85086c22e3b6bd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:53:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:53:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:53:50,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7952c1ffcb36612cf85086c22e3b6bd1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59717497, jitterRate=-0.11013995110988617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:53:50,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:50,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., pid=41, masterSystemTime=1699613630353 2023-11-10 10:53:50,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:50,369 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:50,369 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613630369"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613630369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613630369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613630369"}]},"ts":"1699613630369"} 2023-11-10 10:53:50,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-10 10:53:50,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 170 msec 2023-11-10 10:53:50,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-10 10:53:50,374 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, ASSIGN in 327 msec 2023-11-10 10:53:50,375 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:53:50,375 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613630375"}]},"ts":"1699613630375"} 2023-11-10 10:53:50,376 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-10 10:53:50,378 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:53:50,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1670 sec 2023-11-10 10:53:50,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/1826cbefd6c94e42818d1ee397b56a75, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/2007b7892f0d4fa6bea396782879d96c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_] to archive 2023-11-10 10:53:50,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:53:50,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/1826cbefd6c94e42818d1ee397b56a75 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/1826cbefd6c94e42818d1ee397b56a75 2023-11-10 10:53:50,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/2007b7892f0d4fa6bea396782879d96c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/2007b7892f0d4fa6bea396782879d96c 2023-11-10 10:53:50,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/family1/32c57a51e3f242df805cb402e0f2cfba_SeqId_47_ 2023-11-10 10:53:51,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-10 10:53:51,321 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-10 10:53:51,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:51,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,351 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:51,351 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:51,351 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:51,351 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:51,351 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,351 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,352 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:51,352 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:51,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:51,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:51,353 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:51,353 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,353 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:51,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,353 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,354 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:51,354 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:51,354 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:51,354 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:51,354 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:51,354 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:51,354 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:51,354 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:51,355 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:53:51,781 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304c9dcbc3695747ce92680f8d2230e3f7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511304c9dcbc3695747ce92680f8d2230e3f7 2023-11-10 10:53:52,185 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/82f9e736d0b142b8be138eea793175a7 2023-11-10 10:53:52,191 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/82f9e736d0b142b8be138eea793175a7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/82f9e736d0b142b8be138eea793175a7 2023-11-10 10:53:52,196 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/82f9e736d0b142b8be138eea793175a7, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-10 10:53:52,197 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 843ms, sequenceid=5, compaction requested=false 2023-11-10 10:53:52,197 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:52,197 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:52,198 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:52,198 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:52,198 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:52,198 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,198 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:52,198 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:52,199 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,199 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:52,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:52,199 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,199 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@72da577c[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:52,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:52,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,202 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,202 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:52,202 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:52,202 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:52,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:52,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,203 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:52,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:52,203 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:52,203 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:52,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:52,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:52,207 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:52,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:52,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:52,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,207 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:52,215 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,215 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,215 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:52,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:52,216 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:52,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:52,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,217 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:52,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:52,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:52,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:52,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,223 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:52,224 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:52,224 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:52,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:52,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:52,324 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:52,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:52,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:52,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:52,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,331 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:52,331 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:52,331 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:52,331 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:52,331 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,331 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,332 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:52,332 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:52,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:52,333 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:52,333 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:52,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:52,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:52,334 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:52,334 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:52,334 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:52,334 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:52,334 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:52,334 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:52,334 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:52,334 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:53:52,746 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282b9b41f7bc3e4e4bbbb13eebfac0a9da to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282b9b41f7bc3e4e4bbbb13eebfac0a9da 2023-11-10 10:53:53,152 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/ab4e379b492642a48897087b6f26b495 2023-11-10 10:53:53,159 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/ab4e379b492642a48897087b6f26b495 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/ab4e379b492642a48897087b6f26b495 2023-11-10 10:53:53,164 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/ab4e379b492642a48897087b6f26b495, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:53:53,165 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 831ms, sequenceid=9, compaction requested=false 2023-11-10 10:53:53,165 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:53,165 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:53,166 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,166 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:53,167 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,167 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:53,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:53,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51838613[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:53,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:53,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,169 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:53,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:53,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:53,169 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,169 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:53,170 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:53,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:53,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:53,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:53,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:53,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:53,173 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:53,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:53,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:53,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,173 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:53,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:53,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:53,175 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:53,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:53,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,177 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:53,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:53,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:53,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,181 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,181 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:53,182 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:53,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:53,182 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:53,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:53,282 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:53,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:53,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:53,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:53,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,292 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:53,292 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:53,292 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:53,292 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:53,293 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,293 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,294 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:53,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:53,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:53,294 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,295 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:53,295 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:53,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:53,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,296 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,296 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:53,296 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:53,296 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:53,296 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:53,296 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:53,296 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:53,296 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:53,296 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:53,296 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:53,297 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:53,709 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201fb7f9f037666494498430fa5d0e9f5bf to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb7f9f037666494498430fa5d0e9f5bf 2023-11-10 10:53:54,116 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/904eed474631487c98d6a28d1d2ff94b 2023-11-10 10:53:54,127 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/904eed474631487c98d6a28d1d2ff94b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/904eed474631487c98d6a28d1d2ff94b 2023-11-10 10:53:54,134 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/904eed474631487c98d6a28d1d2ff94b, entries=1, sequenceid=13, filesize=5.0 K 2023-11-10 10:53:54,135 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 838ms, sequenceid=13, compaction requested=true 2023-11-10 10:53:54,135 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:54,135 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:54,135 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:54,135 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:54,135 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,135 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:54,135 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:54,137 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:54,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19424b8d[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:54,138 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:54,138 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,139 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,139 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:54,139 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:54,139 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:54,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:54,140 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,140 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:54,140 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:54,140 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:54,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:54,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:54,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:54,142 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:54,142 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:54,142 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:54,142 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:54,142 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,142 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:54,143 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,143 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:54,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,143 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:54,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:54,144 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,145 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:54,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:54,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:54,147 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:54,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:54,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:54,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:54,147 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:54,247 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:54,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:54,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:54,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:54,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,262 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:54,262 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:54,262 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:54,262 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:54,263 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,263 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,265 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:54,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:54,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:54,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:54,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:54,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:54,267 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:54,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:54,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:54,268 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:54,685 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b2398618685947b6b7aefd3612edb26d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205b2398618685947b6b7aefd3612edb26d 2023-11-10 10:53:55,095 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/057bcd63d70e47eea6feabc4df880d8e 2023-11-10 10:53:55,104 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/057bcd63d70e47eea6feabc4df880d8e as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/057bcd63d70e47eea6feabc4df880d8e 2023-11-10 10:53:55,113 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/057bcd63d70e47eea6feabc4df880d8e, entries=1, sequenceid=17, filesize=5.0 K 2023-11-10 10:53:55,115 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 847ms, sequenceid=17, compaction requested=true 2023-11-10 10:53:55,115 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:55,115 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:55,115 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:55,115 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:55,115 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,115 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:55,115 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:55,117 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,117 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:55,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:55,118 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,118 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:55,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:55,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:55,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@556d8f3a[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:55,120 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:55,120 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,121 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,121 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:55,121 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:55,121 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,121 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:55,121 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:55,122 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:55,122 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,122 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:55,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:55,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:55,122 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:55,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:55,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:55,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:55,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:55,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:55,124 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:55,124 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:55,124 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:55,124 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,124 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:55,125 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,125 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:55,126 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:55,126 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,127 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:55,129 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,129 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:55,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:55,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:55,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:55,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:55,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:55,129 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:55,229 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:55,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:55,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:55,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:55,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,237 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:55,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:55,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:55,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:55,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,240 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:55,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:55,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:55,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:55,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:55,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,241 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,241 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:55,241 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:55,241 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:55,241 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:55,241 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:55,241 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:55,241 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:55,241 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:55,242 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:55,242 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:55,662 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283473880a766e4d3ab7a2096e20ad8971 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283473880a766e4d3ab7a2096e20ad8971 2023-11-10 10:53:55,887 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:53:56,070 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/8db92caaeeeb46e4b74b8b1dde5fc876 2023-11-10 10:53:56,079 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/8db92caaeeeb46e4b74b8b1dde5fc876 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/8db92caaeeeb46e4b74b8b1dde5fc876 2023-11-10 10:53:56,086 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/8db92caaeeeb46e4b74b8b1dde5fc876, entries=1, sequenceid=21, filesize=5.0 K 2023-11-10 10:53:56,087 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 845ms, sequenceid=21, compaction requested=true 2023-11-10 10:53:56,087 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:56,087 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:56,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:56,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:56,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:56,087 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:56,089 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:56,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:56,089 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:56,090 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,090 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:56,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:56,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:56,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:56,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@752c535c[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:56,091 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:56,091 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,092 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,092 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:56,092 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:56,092 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:56,092 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,092 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:56,093 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,093 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:56,093 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:56,093 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:56,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:56,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:56,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:56,095 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:56,096 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:56,096 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:56,096 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,096 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:56,097 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,097 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,097 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:56,097 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,097 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:56,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:56,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,098 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:56,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:56,100 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:56,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:56,101 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,101 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,101 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,101 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:56,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:56,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:56,101 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:56,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:56,101 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:56,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:56,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:56,201 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:56,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:56,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:56,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:56,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,207 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:56,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:56,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:56,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:56,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,207 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,208 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:56,208 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:56,209 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:56,209 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:56,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:56,210 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:56,210 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:56,210 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:56,210 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:56,210 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:56,210 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:56,210 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:56,210 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:56,623 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316b0b51e7c6cf428e91caf8fac00af564 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512316b0b51e7c6cf428e91caf8fac00af564 2023-11-10 10:53:57,035 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/47964194eda6459b8a77223d1d3f1c48 2023-11-10 10:53:57,040 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/47964194eda6459b8a77223d1d3f1c48 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/47964194eda6459b8a77223d1d3f1c48 2023-11-10 10:53:57,045 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/47964194eda6459b8a77223d1d3f1c48, entries=1, sequenceid=25, filesize=5.0 K 2023-11-10 10:53:57,045 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 835ms, sequenceid=25, compaction requested=true 2023-11-10 10:53:57,046 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:57,046 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:57,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:57,047 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,047 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:57,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:57,047 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:57,047 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:57,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:57,048 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:57,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3852f0f4[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:57,048 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,049 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,049 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:57,049 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:57,049 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:57,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:57,050 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,050 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:57,050 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:57,050 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:57,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:57,053 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:57,053 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:57,053 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:57,053 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,053 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:57,054 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,054 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:57,054 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:57,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:57,055 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,056 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,059 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:57,059 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:57,059 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:57,059 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:57,059 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:57,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:57,059 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,060 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:57,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:57,160 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:57,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:57,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:57,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:57,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,166 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:57,166 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:57,166 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:57,166 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:57,167 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,167 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,168 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:57,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:57,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:57,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:57,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:57,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:57,169 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:57,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:57,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:57,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:57,169 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:57,169 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:57,169 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:57,169 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:57,591 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019f2a27678e64480a82ec2c2c67996e65 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019f2a27678e64480a82ec2c2c67996e65 2023-11-10 10:53:57,602 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a 2023-11-10 10:53:57,608 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a 2023-11-10 10:53:57,615 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a, entries=1, sequenceid=29, filesize=5.0 K 2023-11-10 10:53:57,617 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 448ms, sequenceid=29, compaction requested=true 2023-11-10 10:53:57,617 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:57,617 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:57,617 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:57,618 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:57,618 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,618 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:57,618 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:57,619 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,619 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:57,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:57,619 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,619 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:57,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:57,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33c7da50[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:57,621 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:57,621 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,624 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,624 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:57,624 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:57,624 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,624 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:57,624 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:57,625 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,625 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:57,625 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:57,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:57,625 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:57,628 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:57,628 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:57,628 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:57,628 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:57,628 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,628 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:57,629 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,629 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:57,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,629 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:57,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:57,630 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,631 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,633 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:57,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:57,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:57,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:57,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:57,633 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,634 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:57,634 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:57,634 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:57,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:57,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:57,734 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:57,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:57,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:57,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:57,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,742 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:57,742 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:57,742 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:57,742 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:57,743 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,743 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,744 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:57,744 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:57,744 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:57,744 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:57,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:57,745 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:57,745 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:57,745 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:57,745 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:57,745 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:57,745 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:57,746 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:57,746 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:58,170 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039cd123e9c5a34040b7393e2d052d5373 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039cd123e9c5a34040b7393e2d052d5373 2023-11-10 10:53:58,179 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/22eece7192194e89abb04a689c4436ca 2023-11-10 10:53:58,185 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/22eece7192194e89abb04a689c4436ca as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/22eece7192194e89abb04a689c4436ca 2023-11-10 10:53:58,190 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/22eece7192194e89abb04a689c4436ca, entries=1, sequenceid=33, filesize=5.0 K 2023-11-10 10:53:58,191 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 445ms, sequenceid=33, compaction requested=true 2023-11-10 10:53:58,191 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:58,191 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:58,191 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:58,191 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:58,191 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,191 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:58,191 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:58,192 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,193 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:58,193 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:58,193 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:58,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:58,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aea974d[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:58,194 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:58,194 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,195 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:58,195 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,195 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:58,196 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:58,196 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,196 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:58,196 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:58,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:58,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:58,198 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:58,198 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:58,198 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:58,198 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,198 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:58,199 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,199 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:58,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,200 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:58,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:58,200 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:58,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:58,203 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:58,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:58,304 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:58,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:58,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:58,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:58,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,310 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:58,310 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:58,310 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:58,310 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:58,310 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,310 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,311 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:58,311 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:58,312 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:58,312 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,316 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:58,316 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:58,316 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:58,317 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:58,317 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:58,317 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:58,317 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:58,317 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:58,317 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:58,317 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:58,732 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ec4af323272c47f3ab5f50150a9d4c3e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907ec4af323272c47f3ab5f50150a9d4c3e 2023-11-10 10:53:59,138 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/f352ab1c11a94c819ce4613f55729e08 2023-11-10 10:53:59,144 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/f352ab1c11a94c819ce4613f55729e08 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/f352ab1c11a94c819ce4613f55729e08 2023-11-10 10:53:59,149 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/f352ab1c11a94c819ce4613f55729e08, entries=1, sequenceid=37, filesize=5.0 K 2023-11-10 10:53:59,150 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 833ms, sequenceid=37, compaction requested=true 2023-11-10 10:53:59,151 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:59,151 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:59,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:59,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:59,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:59,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:59,163 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,163 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:59,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:59,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:59,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:59,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d4b93ff[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:59,166 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:59,166 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,167 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:59,167 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:59,167 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:59,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,168 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:59,170 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:59,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:59,170 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:59,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:59,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:59,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:59,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:59,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:59,173 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:59,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:59,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:59,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,173 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:59,182 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,182 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,182 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:59,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,183 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,184 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,190 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,190 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:59,190 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:59,190 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:59,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:59,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:59,190 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,190 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:59,191 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,191 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,191 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,191 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,191 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:59,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:59,191 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:59,291 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:59,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:59,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:53:59,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-10 10:53:59,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,301 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:59,301 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:59,301 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-10 10:53:59,301 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-10 10:53:59,302 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,302 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,302 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:59,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:59,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:59,303 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,307 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,307 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:53:59,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:53:59,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-10 10:53:59,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-10 10:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-10 10:53:59,318 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:53:59,319 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:53:59,319 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:59,319 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. started... 2023-11-10 10:53:59,319 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7952c1ffcb36612cf85086c22e3b6bd1 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:53:59,357 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c15f569ce7b142408161fd855cda1e72 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c15f569ce7b142408161fd855cda1e72 2023-11-10 10:53:59,362 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/890748d45259406f8065507b75bb6c1b 2023-11-10 10:53:59,369 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/890748d45259406f8065507b75bb6c1b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/890748d45259406f8065507b75bb6c1b 2023-11-10 10:53:59,373 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/890748d45259406f8065507b75bb6c1b, entries=1, sequenceid=41, filesize=5.0 K 2023-11-10 10:53:59,379 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7952c1ffcb36612cf85086c22e3b6bd1 in 60ms, sequenceid=41, compaction requested=true 2023-11-10 10:53:59,379 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:53:59,379 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:53:59,379 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:53:59,379 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:53:59,379 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,379 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-10 10:53:59,379 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-10 10:53:59,382 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,382 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:59,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:59,382 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,382 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:53:59,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:59,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:59,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:59,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-10 10:53:59,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32b115f2[Count = 0] remaining members to acquire global barrier 2023-11-10 10:53:59,384 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-10 10:53:59,384 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,385 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,385 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-10 10:53:59,385 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-10 10:53:59,385 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:53:59,385 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,385 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:53:59,386 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-10 10:53:59,386 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,386 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:59,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:59,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:59,386 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-10 10:53:59,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:59,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:59,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:59,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:53:59,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-10 10:53:59,389 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-10 10:53:59,389 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:53:59,389 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:53:59,389 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,389 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:53:59,390 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:53:59,390 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:53:59,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,390 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:59,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:53:59,391 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:59,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:59,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:53:59,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,393 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:53:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,395 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:53:59,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-10 10:53:59,395 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:53:59,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:53:59,395 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:53:59,396 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:53:59,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:53:59,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:53:59,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:53:59,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:53:59,397 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-10 10:53:59,397 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:53:59,498 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:53:59,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:53:59,503 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:53:59,506 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:59,507 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:53:59,508 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:53:59,508 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614239508 2023-11-10 10:53:59,509 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:53:59,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-10 10:53:59,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:53:59,512 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x46cc575c to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:53:59,535 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@524cc6e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:53:59,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,008 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fcd588b8cf804bbba918f2fe6b59132a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103fcd588b8cf804bbba918f2fe6b59132a 2023-11-10 10:54:00,010 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:00,023 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:00,024 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:00,030 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:00,032 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50364, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:00,043 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/777c6695a71a481dbecf7fe91df1d590 first=Optional[r3] last=Optional[r6] 2023-11-10 10:54:00,044 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/777c6695a71a481dbecf7fe91df1d590}] 2023-11-10 10:54:00,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/777c6695a71a481dbecf7fe91df1d590 for inclusion in 7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:00,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-10 10:54:00,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:00,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:00,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/777c6695a71a481dbecf7fe91df1d590 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__glj588add99sf8tnk8qt0jgjm017a0du1jmrnvnkj64003uqu72abgj712oe33l/family1/777c6695a71a481dbecf7fe91df1d590 2023-11-10 10:54:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__glj588add99sf8tnk8qt0jgjm017a0du1jmrnvnkj64003uqu72abgj712oe33l/family1/777c6695a71a481dbecf7fe91df1d590 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_ 2023-11-10 10:54:00,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__glj588add99sf8tnk8qt0jgjm017a0du1jmrnvnkj64003uqu72abgj712oe33l/family1/777c6695a71a481dbecf7fe91df1d590 into 7952c1ffcb36612cf85086c22e3b6bd1/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_ - updating store file list. 2023-11-10 10:54:00,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_ into 7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:00,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__glj588add99sf8tnk8qt0jgjm017a0du1jmrnvnkj64003uqu72abgj712oe33l/family1/777c6695a71a481dbecf7fe91df1d590 into 7952c1ffcb36612cf85086c22e3b6bd1/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_) 2023-11-10 10:54:00,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__glj588add99sf8tnk8qt0jgjm017a0du1jmrnvnkj64003uqu72abgj712oe33l/family1/777c6695a71a481dbecf7fe91df1d590 2023-11-10 10:54:00,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:54:00,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:54:00,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 7952c1ffcb36612cf85086c22e3b6bd1/family1 is initiating minor compaction 2023-11-10 10:54:00,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@36b7e2c2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:00,065 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7952c1ffcb36612cf85086c22e3b6bd1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:00,065 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/ab4e379b492642a48897087b6f26b495, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/904eed474631487c98d6a28d1d2ff94b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/057bcd63d70e47eea6feabc4df880d8e, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/8db92caaeeeb46e4b74b8b1dde5fc876, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/47964194eda6459b8a77223d1d3f1c48, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/22eece7192194e89abb04a689c4436ca, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/f352ab1c11a94c819ce4613f55729e08, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/890748d45259406f8065507b75bb6c1b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp, totalSize=50.4 K 2023-11-10 10:54:00,065 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting ab4e379b492642a48897087b6f26b495, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 904eed474631487c98d6a28d1d2ff94b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 057bcd63d70e47eea6feabc4df880d8e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 8db92caaeeeb46e4b74b8b1dde5fc876, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 47964194eda6459b8a77223d1d3f1c48, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting aefd3707cf1249a0a4ba2d8cb07b8b1a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 22eece7192194e89abb04a689c4436ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting f352ab1c11a94c819ce4613f55729e08, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 890748d45259406f8065507b75bb6c1b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:54:00,066 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting e64af69c87874cffa4179c2f1bef09b8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:54:00,067 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:00,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:00,069 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283473880a766e4d3ab7a2096e20ad8971 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512283473880a766e4d3ab7a2096e20ad8971 2023-11-10 10:54:00,070 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512316b0b51e7c6cf428e91caf8fac00af564 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512316b0b51e7c6cf428e91caf8fac00af564 2023-11-10 10:54:00,071 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019f2a27678e64480a82ec2c2c67996e65 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019f2a27678e64480a82ec2c2c67996e65 2023-11-10 10:54:00,072 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039cd123e9c5a34040b7393e2d052d5373 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039cd123e9c5a34040b7393e2d052d5373 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-10 10:54:00,073 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:00,100 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7952c1ffcb36612cf85086c22e3b6bd1#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:00,927 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/87c15cf5acff4f0d8e123d74488967b1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/87c15cf5acff4f0d8e123d74488967b1 2023-11-10 10:54:00,932 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7952c1ffcb36612cf85086c22e3b6bd1/family1 of 7952c1ffcb36612cf85086c22e3b6bd1 into 87c15cf5acff4f0d8e123d74488967b1(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:54:00,932 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:00,933 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699613640065; duration=0sec 2023-11-10 10:54:00,933 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:00,950 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052b18b5fb01d5450d8da74b66f168f11c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052b18b5fb01d5450d8da74b66f168f11c 2023-11-10 10:54:00,951 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:00,985 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/15915a5e97c441be8e3932a3611bcac7 first=Optional[r00] last=Optional[r2] 2023-11-10 10:54:00,986 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/15915a5e97c441be8e3932a3611bcac7}] 2023-11-10 10:54:00,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/ab4e379b492642a48897087b6f26b495, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/904eed474631487c98d6a28d1d2ff94b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/057bcd63d70e47eea6feabc4df880d8e, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/8db92caaeeeb46e4b74b8b1dde5fc876, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/47964194eda6459b8a77223d1d3f1c48, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/22eece7192194e89abb04a689c4436ca, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/f352ab1c11a94c819ce4613f55729e08, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/890748d45259406f8065507b75bb6c1b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_] to archive 2023-11-10 10:54:00,991 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:00,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/15915a5e97c441be8e3932a3611bcac7 for inclusion in 7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:00,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/ab4e379b492642a48897087b6f26b495 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/ab4e379b492642a48897087b6f26b495 2023-11-10 10:54:00,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-10 10:54:00,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:00,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:00,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/904eed474631487c98d6a28d1d2ff94b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/904eed474631487c98d6a28d1d2ff94b 2023-11-10 10:54:00,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/15915a5e97c441be8e3932a3611bcac7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n25emppiid10268hi0a28j2hoq575mh18afc04mr44ank06j3hap2hds3i491gb4/family1/15915a5e97c441be8e3932a3611bcac7 2023-11-10 10:54:00,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/057bcd63d70e47eea6feabc4df880d8e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/057bcd63d70e47eea6feabc4df880d8e 2023-11-10 10:54:00,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/8db92caaeeeb46e4b74b8b1dde5fc876 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/8db92caaeeeb46e4b74b8b1dde5fc876 2023-11-10 10:54:00,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n25emppiid10268hi0a28j2hoq575mh18afc04mr44ank06j3hap2hds3i491gb4/family1/15915a5e97c441be8e3932a3611bcac7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_ 2023-11-10 10:54:00,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n25emppiid10268hi0a28j2hoq575mh18afc04mr44ank06j3hap2hds3i491gb4/family1/15915a5e97c441be8e3932a3611bcac7 into 7952c1ffcb36612cf85086c22e3b6bd1/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_ - updating store file list. 2023-11-10 10:54:00,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/47964194eda6459b8a77223d1d3f1c48 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/47964194eda6459b8a77223d1d3f1c48 2023-11-10 10:54:00,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/aefd3707cf1249a0a4ba2d8cb07b8b1a 2023-11-10 10:54:01,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/22eece7192194e89abb04a689c4436ca to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/22eece7192194e89abb04a689c4436ca 2023-11-10 10:54:01,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_ into 7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:01,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/f352ab1c11a94c819ce4613f55729e08 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/f352ab1c11a94c819ce4613f55729e08 2023-11-10 10:54:01,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n25emppiid10268hi0a28j2hoq575mh18afc04mr44ank06j3hap2hds3i491gb4/family1/15915a5e97c441be8e3932a3611bcac7 into 7952c1ffcb36612cf85086c22e3b6bd1/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_) 2023-11-10 10:54:01,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n25emppiid10268hi0a28j2hoq575mh18afc04mr44ank06j3hap2hds3i491gb4/family1/15915a5e97c441be8e3932a3611bcac7 2023-11-10 10:54:01,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:54:01,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/890748d45259406f8065507b75bb6c1b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/890748d45259406f8065507b75bb6c1b 2023-11-10 10:54:01,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:54:01,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 7952c1ffcb36612cf85086c22e3b6bd1/family1 is initiating minor compaction (all files) 2023-11-10 10:54:01,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@502ed5f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:01,003 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7952c1ffcb36612cf85086c22e3b6bd1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:01,003 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/82f9e736d0b142b8be138eea793175a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/87c15cf5acff4f0d8e123d74488967b1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp, totalSize=390.1 K 2023-11-10 10:54:01,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/e64af69c87874cffa4179c2f1bef09b8_SeqId_44_ 2023-11-10 10:54:01,003 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 82f9e736d0b142b8be138eea793175a7, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:54:01,004 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 87c15cf5acff4f0d8e123d74488967b1, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:54:01,009 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878854600 2023-11-10 10:54:01,009 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:01,010 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:01,011 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511304c9dcbc3695747ce92680f8d2230e3f7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511304c9dcbc3695747ce92680f8d2230e3f7 2023-11-10 10:54:01,012 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb7f9f037666494498430fa5d0e9f5bf to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201fb7f9f037666494498430fa5d0e9f5bf 2023-11-10 10:54:01,014 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205b2398618685947b6b7aefd3612edb26d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205b2398618685947b6b7aefd3612edb26d 2023-11-10 10:54:01,014 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-10 10:54:01,014 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-10 10:54:01,014 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:01,014 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:01,014 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:01,016 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:01,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.5130 sec 2023-11-10 10:54:01,028 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7952c1ffcb36612cf85086c22e3b6bd1#family1#compaction#62 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:01,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-10 10:54:01,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:54:01,495 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:01,496 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:01,496 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:01,498 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-10 10:54:01,500 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE}] 2023-11-10 10:54:01,501 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE 2023-11-10 10:54:01,502 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:01,502 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613641502"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613641502"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613641502"}]},"ts":"1699613641502"} 2023-11-10 10:54:01,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:01,655 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:01,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:01,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7952c1ffcb36612cf85086c22e3b6bd1, disabling compactions & flushes 2023-11-10 10:54:01,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,247 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/.tmp/family1/417367610cc24cfeba24e12b4febdd2b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/417367610cc24cfeba24e12b4febdd2b 2023-11-10 10:54:02,253 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7952c1ffcb36612cf85086c22e3b6bd1/family1 of 7952c1ffcb36612cf85086c22e3b6bd1 into 417367610cc24cfeba24e12b4febdd2b(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:02,253 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:02,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. after waiting 0 ms 2023-11-10 10:54:02,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,254 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1699613641003; duration=1sec 2023-11-10 10:54:02,256 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:02,256 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/82f9e736d0b142b8be138eea793175a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/87c15cf5acff4f0d8e123d74488967b1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_] to archive 2023-11-10 10:54:02,257 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:02,259 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/82f9e736d0b142b8be138eea793175a7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/82f9e736d0b142b8be138eea793175a7 2023-11-10 10:54:02,261 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/87c15cf5acff4f0d8e123d74488967b1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/87c15cf5acff4f0d8e123d74488967b1 2023-11-10 10:54:02,262 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/fad90ebac3004524b8f8ff2f0c5f1e10_SeqId_47_ 2023-11-10 10:54:02,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-10 10:54:02,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:02,269 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 7952c1ffcb36612cf85086c22e3b6bd1 to self. 2023-11-10 10:54:02,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,271 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=CLOSED 2023-11-10 10:54:02,271 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613642271"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613642271"}]},"ts":"1699613642271"} 2023-11-10 10:54:02,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-10 10:54:02,274 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 770 msec 2023-11-10 10:54:02,275 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=true 2023-11-10 10:54:02,425 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:02,425 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613642425"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613642425"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613642425"}]},"ts":"1699613642425"} 2023-11-10 10:54:02,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:02,578 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:02,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7952c1ffcb36612cf85086c22e3b6bd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:54:02,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:02,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,583 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,584 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:02,584 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:02,585 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7952c1ffcb36612cf85086c22e3b6bd1 columnFamilyName family1 2023-11-10 10:54:02,590 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/417367610cc24cfeba24e12b4febdd2b 2023-11-10 10:54:02,590 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(310): Store=7952c1ffcb36612cf85086c22e3b6bd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:02,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:02,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7952c1ffcb36612cf85086c22e3b6bd1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71592056, jitterRate=0.06680476665496826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:54:02,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:02,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., pid=47, masterSystemTime=1699613642578 2023-11-10 10:54:02,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:02,602 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:02,602 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613642602"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613642602"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613642602"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613642602"}]},"ts":"1699613642602"} 2023-11-10 10:54:02,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-10 10:54:02,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 177 msec 2023-11-10 10:54:02,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-10 10:54:02,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE in 1.1050 sec 2023-11-10 10:54:02,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-10 10:54:02,609 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1100 sec 2023-11-10 10:54:02,611 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5250 sec 2023-11-10 10:54:02,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-10 10:54:02,613 INFO [Listener at localhost/37195] compactions.TestMobCompactor(278): alter status finished 2023-11-10 10:54:02,614 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:54:02,615 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:02,617 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:02,618 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:02,618 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614242618 2023-11-10 10:54:02,619 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:54:02,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-10 10:54:02,620 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:02,622 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x6c81d3c3 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:02,626 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@584e7375, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:02,626 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:02,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:02,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:02,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:02,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:03,467 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e2866e1bfc9d42c194455076bc91b751 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128e2866e1bfc9d42c194455076bc91b751 2023-11-10 10:54:03,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:03,486 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:03,487 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:03,494 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:03,496 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:03,507 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/504669922b6742528ab7a7e25df6bedb first=Optional[r05] last=Optional[r8] 2023-11-10 10:54:03,508 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/504669922b6742528ab7a7e25df6bedb}] 2023-11-10 10:54:03,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/504669922b6742528ab7a7e25df6bedb for inclusion in 7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:03,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-10 10:54:03,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:03,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:03,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/504669922b6742528ab7a7e25df6bedb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9jncrbs0r3o4tpar6033ip68k44llr1rkrfi4rr2f9e615jt1dnrc6ec45vudgl5/family1/504669922b6742528ab7a7e25df6bedb 2023-11-10 10:54:03,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9jncrbs0r3o4tpar6033ip68k44llr1rkrfi4rr2f9e615jt1dnrc6ec45vudgl5/family1/504669922b6742528ab7a7e25df6bedb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/2f4cff67cc164413b36edf2e593c4143_SeqId_53_ 2023-11-10 10:54:03,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9jncrbs0r3o4tpar6033ip68k44llr1rkrfi4rr2f9e615jt1dnrc6ec45vudgl5/family1/504669922b6742528ab7a7e25df6bedb into 7952c1ffcb36612cf85086c22e3b6bd1/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/2f4cff67cc164413b36edf2e593c4143_SeqId_53_ - updating store file list. 2023-11-10 10:54:03,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/2f4cff67cc164413b36edf2e593c4143_SeqId_53_ into 7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:03,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9jncrbs0r3o4tpar6033ip68k44llr1rkrfi4rr2f9e615jt1dnrc6ec45vudgl5/family1/504669922b6742528ab7a7e25df6bedb into 7952c1ffcb36612cf85086c22e3b6bd1/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/2f4cff67cc164413b36edf2e593c4143_SeqId_53_) 2023-11-10 10:54:03,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__9jncrbs0r3o4tpar6033ip68k44llr1rkrfi4rr2f9e615jt1dnrc6ec45vudgl5/family1/504669922b6742528ab7a7e25df6bedb 2023-11-10 10:54:03,539 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:03,540 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:03,541 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c15f569ce7b142408161fd855cda1e72 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120c15f569ce7b142408161fd855cda1e72 2023-11-10 10:54:03,544 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282b9b41f7bc3e4e4bbbb13eebfac0a9da to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282b9b41f7bc3e4e4bbbb13eebfac0a9da 2023-11-10 10:54:03,544 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-10 10:54:03,544 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-10 10:54:03,545 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:03,545 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:03,545 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:03,545 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:03,545 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:03,546 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:03,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 931 msec 2023-11-10 10:54:03,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-10 10:54:03,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:54:04,020 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-10 10:54:04,021 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:04,021 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-10 10:54:04,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-10 10:54:04,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE}] 2023-11-10 10:54:04,026 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE 2023-11-10 10:54:04,027 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:04,027 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613644027"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613644027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613644027"}]},"ts":"1699613644027"} 2023-11-10 10:54:04,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:04,180 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:04,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7952c1ffcb36612cf85086c22e3b6bd1, disabling compactions & flushes 2023-11-10 10:54:04,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. after waiting 0 ms 2023-11-10 10:54:04,181 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-10 10:54:04,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:04,188 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 7952c1ffcb36612cf85086c22e3b6bd1 to self. 2023-11-10 10:54:04,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,190 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=CLOSED 2023-11-10 10:54:04,190 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613644190"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613644190"}]},"ts":"1699613644190"} 2023-11-10 10:54:04,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-10 10:54:04,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 162 msec 2023-11-10 10:54:04,193 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=true 2023-11-10 10:54:04,344 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:04,344 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613644344"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613644344"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613644344"}]},"ts":"1699613644344"} 2023-11-10 10:54:04,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:04,496 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:04,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7952c1ffcb36612cf85086c22e3b6bd1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:54:04,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:04,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,505 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,506 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:04,507 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1 2023-11-10 10:54:04,507 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7952c1ffcb36612cf85086c22e3b6bd1 columnFamilyName family1 2023-11-10 10:54:04,520 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/2f4cff67cc164413b36edf2e593c4143_SeqId_53_ 2023-11-10 10:54:04,526 DEBUG [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/family1/417367610cc24cfeba24e12b4febdd2b 2023-11-10 10:54:04,526 INFO [StoreOpener-7952c1ffcb36612cf85086c22e3b6bd1-1] regionserver.HStore(310): Store=7952c1ffcb36612cf85086c22e3b6bd1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:04,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:54:04,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7952c1ffcb36612cf85086c22e3b6bd1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63191748, jitterRate=-0.058369576930999756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:54:04,533 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:54:04,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1., pid=53, masterSystemTime=1699613644496 2023-11-10 10:54:04,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:54:04,536 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7952c1ffcb36612cf85086c22e3b6bd1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:04,536 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699613644536"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613644536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613644536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613644536"}]},"ts":"1699613644536"} 2023-11-10 10:54:04,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-10 10:54:04,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 7952c1ffcb36612cf85086c22e3b6bd1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 192 msec 2023-11-10 10:54:04,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-10 10:54:04,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7952c1ffcb36612cf85086c22e3b6bd1, REOPEN/MOVE in 514 msec 2023-11-10 10:54:04,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-10 10:54:04,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 519 msec 2023-11-10 10:54:04,546 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 937 msec 2023-11-10 10:54:04,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-10 10:54:04,549 INFO [Listener at localhost/37195] compactions.TestMobCompactor(278): alter status finished 2023-11-10 10:54:04,550 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-10 10:54:04,552 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:04,552 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:04,553 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:04,553 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614244553 2023-11-10 10:54:04,554 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:54:04,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-10 10:54:04,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:04,556 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x17638441 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:04,566 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c9d9803, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:04,566 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-10 10:54:04,567 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-10 10:54:04,567 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:04,569 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-10 10:54:04,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 18 msec 2023-11-10 10:54:04,627 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=253 (was 258), OpenFileDescriptor=659 (was 646) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 222), ProcessCount=166 (was 166), AvailableMemoryMB=8866 (was 9287) 2023-11-10 10:54:04,641 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=253, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=166, AvailableMemoryMB=8864 2023-11-10 10:54:04,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-10 10:54:04,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:04,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:54:04,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-10 10:54:04,646 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:54:04,648 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:04,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-10 10:54:04,648 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 empty. 2023-11-10 10:54:04,649 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:04,649 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-10 10:54:04,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-10 10:54:04,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-10 10:54:05,059 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:05,061 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => fe690bcf7d1c51ffd313a540edb9d688, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:05,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-10 10:54:05,468 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:05,468 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing fe690bcf7d1c51ffd313a540edb9d688, disabling compactions & flushes 2023-11-10 10:54:05,468 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,468 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,468 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. after waiting 0 ms 2023-11-10 10:54:05,468 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,468 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,468 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:05,471 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:54:05,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613645473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613645473"}]},"ts":"1699613645473"} 2023-11-10 10:54:05,474 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:54:05,475 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:54:05,475 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613645475"}]},"ts":"1699613645475"} 2023-11-10 10:54:05,477 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-10 10:54:05,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, ASSIGN}] 2023-11-10 10:54:05,482 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, ASSIGN 2023-11-10 10:54:05,483 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:05,634 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:05,634 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613645634"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613645634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613645634"}]},"ts":"1699613645634"} 2023-11-10 10:54:05,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:05,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-10 10:54:05,788 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:05,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe690bcf7d1c51ffd313a540edb9d688, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:54:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,793 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,795 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:05,795 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:05,795 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe690bcf7d1c51ffd313a540edb9d688 columnFamilyName family1 2023-11-10 10:54:05,797 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(310): Store=fe690bcf7d1c51ffd313a540edb9d688/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:05,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:05,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:05,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fe690bcf7d1c51ffd313a540edb9d688; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64121592, jitterRate=-0.044513821601867676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:54:05,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:05,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., pid=57, masterSystemTime=1699613645788 2023-11-10 10:54:05,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:05,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:05,806 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613645806"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613645806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613645806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613645806"}]},"ts":"1699613645806"} 2023-11-10 10:54:05,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-10 10:54:05,809 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510 in 171 msec 2023-11-10 10:54:05,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-10 10:54:05,810 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, ASSIGN in 329 msec 2023-11-10 10:54:05,811 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:54:05,811 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613645811"}]},"ts":"1699613645811"} 2023-11-10 10:54:05,812 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-10 10:54:05,815 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:54:05,816 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1720 sec 2023-11-10 10:54:06,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-10 10:54:06,755 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-10 10:54:06,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:06,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,800 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:06,800 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:06,800 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:06,800 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:06,814 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,814 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,815 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:06,815 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:06,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:06,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:06,816 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:06,816 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:06,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,816 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:06,818 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:06,818 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:06,818 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:06,819 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:06,819 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:06,819 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:06,819 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:06,820 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:54:07,251 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130fcd87cce5f5f4a32814e14fe58029456 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130fcd87cce5f5f4a32814e14fe58029456 2023-11-10 10:54:07,656 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/22b95d2e4f834a16922b86b225336980 2023-11-10 10:54:07,665 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/22b95d2e4f834a16922b86b225336980 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/22b95d2e4f834a16922b86b225336980 2023-11-10 10:54:07,670 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/22b95d2e4f834a16922b86b225336980, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-10 10:54:07,671 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 851ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:07,671 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:07,671 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:07,671 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:07,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:07,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:07,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:07,672 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:07,673 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,673 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:07,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:07,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:07,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:07,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:07,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3fa95cae[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:07,675 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:07,675 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,675 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,676 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:07,676 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:07,676 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,676 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:07,676 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:07,678 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:07,678 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:07,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:07,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:07,680 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:07,680 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:07,681 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:07,681 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,681 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:07,681 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,681 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:07,681 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:07,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:07,682 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,683 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:07,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:07,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:07,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:07,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:07,685 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:07,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:07,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:07,685 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:07,786 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:07,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:07,791 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:07,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:07,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,793 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:07,793 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:07,793 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:07,793 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:07,794 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,794 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,795 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:07,795 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:07,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:07,796 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:07,796 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:07,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,797 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:07,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,798 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,798 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:07,798 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:07,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:07,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:07,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:07,799 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:07,799 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:07,799 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:07,799 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:07,799 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:54:07,810 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:54:08,218 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128aa2a8e6774684197aa102e2552c25b34 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa2a8e6774684197aa102e2552c25b34 2023-11-10 10:54:08,624 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b 2023-11-10 10:54:08,629 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b 2023-11-10 10:54:08,635 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:54:08,635 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 836ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:08,636 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:08,636 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:08,636 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:08,636 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:08,636 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,636 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:08,636 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:08,637 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,637 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:08,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:08,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:08,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61a7f4e9[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:08,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:08,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,640 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,640 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:08,640 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:08,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:08,640 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:08,641 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:08,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:08,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:08,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:08,642 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:08,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:08,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:08,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:08,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:08,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:08,644 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:08,644 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:08,644 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:08,644 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,644 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:08,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:08,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:08,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:08,646 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,647 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:08,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,649 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:08,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:08,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:08,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:08,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,650 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:08,650 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:08,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:08,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:08,750 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:08,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:08,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:08,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:08,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,758 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:08,758 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:08,759 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:08,759 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:08,759 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,759 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:08,760 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:08,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:08,760 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,760 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:08,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:08,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,761 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,762 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:08,762 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:08,762 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:08,762 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:08,763 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:08,763 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:08,791 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015eea140a7ec34d4fa586484ba03a68f8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015eea140a7ec34d4fa586484ba03a68f8 2023-11-10 10:54:08,803 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/d022219db2944066a1c6ccb342278d76 2023-11-10 10:54:08,809 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/d022219db2944066a1c6ccb342278d76 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/d022219db2944066a1c6ccb342278d76 2023-11-10 10:54:08,818 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/d022219db2944066a1c6ccb342278d76, entries=1, sequenceid=13, filesize=5.0 K 2023-11-10 10:54:08,819 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 56ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:08,819 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:08,819 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:08,820 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:08,820 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:08,820 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,820 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:08,820 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:08,821 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,821 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:08,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:08,822 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,822 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:08,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:08,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:08,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20324749[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:08,824 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:08,824 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,825 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,825 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:08,825 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:08,825 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:08,825 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,825 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:08,826 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,826 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:08,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:08,826 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:08,826 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:08,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:08,829 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:08,829 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:08,829 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:08,829 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,829 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:08,831 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,831 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,831 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:08,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:08,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:08,831 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,833 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:08,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:08,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,836 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:08,836 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-10 10:54:08,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:08,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:08,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:08,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:08,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:08,836 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,837 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:08,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:08,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:08,837 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:08,937 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:08,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:08,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:08,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:08,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,943 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:08,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:08,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:08,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:08,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,945 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:08,945 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:08,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:08,946 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:08,946 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,946 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:08,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:08,947 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:08,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:08,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:08,947 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:09,363 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120533bbb6690c6d449cb5bff9b694047523 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533bbb6690c6d449cb5bff9b694047523 2023-11-10 10:54:09,769 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/993a99b0644f43ba9b6126a1946ca7ed 2023-11-10 10:54:09,783 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/993a99b0644f43ba9b6126a1946ca7ed as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/993a99b0644f43ba9b6126a1946ca7ed 2023-11-10 10:54:09,789 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/993a99b0644f43ba9b6126a1946ca7ed, entries=1, sequenceid=17, filesize=5.0 K 2023-11-10 10:54:09,790 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 843ms, sequenceid=17, compaction requested=true 2023-11-10 10:54:09,790 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:09,790 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:09,790 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:09,790 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:09,790 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,790 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:09,790 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:09,791 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,791 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:09,792 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,792 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:09,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:09,793 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:09,793 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a96d838[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:09,793 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,794 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,794 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:09,794 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:09,794 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,794 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:09,794 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:09,795 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:09,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:09,795 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:09,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:09,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:09,797 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:09,797 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:09,797 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:09,797 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,797 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:09,798 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,798 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:09,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:09,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,798 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:09,799 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,800 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:09,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:09,802 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:09,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:09,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:09,802 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:09,902 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:09,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:09,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:09,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:09,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,908 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:09,908 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:09,909 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:09,909 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:09,909 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,909 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,910 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,910 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:09,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:09,910 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:09,910 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:09,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,911 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,911 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:09,911 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:09,911 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:09,911 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:09,911 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:09,911 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:09,911 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:09,912 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:09,912 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:09,912 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:10,326 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228390217f6e2ac4c8d867b91af99525589 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228390217f6e2ac4c8d867b91af99525589 2023-11-10 10:54:10,382 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-10 10:54:10,731 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/b11b100f1a184cb085f6d252b3c882a0 2023-11-10 10:54:10,740 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/b11b100f1a184cb085f6d252b3c882a0 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b11b100f1a184cb085f6d252b3c882a0 2023-11-10 10:54:10,745 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b11b100f1a184cb085f6d252b3c882a0, entries=1, sequenceid=21, filesize=5.0 K 2023-11-10 10:54:10,746 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 834ms, sequenceid=21, compaction requested=true 2023-11-10 10:54:10,746 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:10,746 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:10,746 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:10,746 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:10,746 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,747 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:10,747 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:10,748 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,748 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:10,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:10,748 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,748 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:10,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:10,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:10,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:10,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:10,751 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:10,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fafabe8[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:10,751 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,752 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,752 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:10,752 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:10,752 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:10,752 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,752 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:10,753 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:10,753 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,753 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,753 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:10,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:10,755 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:10,755 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:10,755 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:10,755 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,755 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:10,756 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,756 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,756 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:10,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:10,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:10,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:10,757 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:10,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,758 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:10,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,759 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,759 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,760 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:10,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:10,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:10,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:10,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:10,760 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:10,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:10,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:10,860 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:10,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:10,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:10,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:10,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,867 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:10,867 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:10,867 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:10,867 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:10,867 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,867 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,868 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,868 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:10,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:10,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:10,868 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:10,868 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:10,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,869 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,870 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:10,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:10,870 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:10,870 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:10,870 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:10,870 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:10,870 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:10,870 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:10,870 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:10,870 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:11,287 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123197215da94a0946a0919cddd5dc1cfefd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123197215da94a0946a0919cddd5dc1cfefd 2023-11-10 10:54:11,696 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/6a0399cdb8044d4d92d01b461ebb2e7f 2023-11-10 10:54:11,702 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/6a0399cdb8044d4d92d01b461ebb2e7f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6a0399cdb8044d4d92d01b461ebb2e7f 2023-11-10 10:54:11,708 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6a0399cdb8044d4d92d01b461ebb2e7f, entries=1, sequenceid=25, filesize=5.0 K 2023-11-10 10:54:11,709 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 839ms, sequenceid=25, compaction requested=true 2023-11-10 10:54:11,709 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:11,709 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:11,709 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:11,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:11,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:11,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:11,711 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,711 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:11,711 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,711 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:11,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:11,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:11,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:11,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:11,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31f10a48[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:11,713 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:11,713 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,714 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:11,714 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:11,714 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:11,714 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,715 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:11,716 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:11,716 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,716 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:11,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:11,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:11,716 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:11,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:11,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:11,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:11,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:11,719 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:11,719 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:11,719 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:11,719 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:11,719 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,719 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:11,721 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:11,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:11,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:11,721 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:11,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,723 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:11,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:11,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,725 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:11,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-10 10:54:11,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:11,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:11,825 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:11,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:11,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:11,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:11,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,835 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:11,835 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:11,835 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:11,835 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:11,836 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,836 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,837 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:11,837 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:11,837 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:11,837 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,838 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,838 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:11,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:11,838 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:11,838 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:11,839 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:11,839 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:12,256 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101adfa7d4c6e0f4586b6ec8be931289b5d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101adfa7d4c6e0f4586b6ec8be931289b5d 2023-11-10 10:54:12,276 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:12,277 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c64a131 to 127.0.0.1:62972 2023-11-10 10:54:12,277 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:12,277 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:12,277 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x569b30a8 to 127.0.0.1:62972 2023-11-10 10:54:12,277 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:12,288 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:12,288 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46cc575c to 127.0.0.1:62972 2023-11-10 10:54:12,288 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:12,289 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17638441 to 127.0.0.1:62972 2023-11-10 10:54:12,289 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:12,289 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:12,289 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c81d3c3 to 127.0.0.1:62972 2023-11-10 10:54:12,289 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:12,691 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/20ae04aa6b214fc29c55b514592d6b6d 2023-11-10 10:54:12,695 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/20ae04aa6b214fc29c55b514592d6b6d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/20ae04aa6b214fc29c55b514592d6b6d 2023-11-10 10:54:12,700 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/20ae04aa6b214fc29c55b514592d6b6d, entries=1, sequenceid=29, filesize=5.0 K 2023-11-10 10:54:12,701 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 862ms, sequenceid=29, compaction requested=true 2023-11-10 10:54:12,701 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:12,701 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:12,701 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:12,702 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:12,703 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,703 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:12,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:12,704 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,704 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:12,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:12,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:12,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34b1b30[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:12,705 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:12,705 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,706 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,706 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:12,706 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:12,706 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:12,706 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,706 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:12,707 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:12,707 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,707 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:12,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:12,707 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:12,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:12,710 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:12,710 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:12,710 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:12,710 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,710 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:12,711 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,711 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,711 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:12,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:12,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:12,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:12,711 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,713 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:12,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:12,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:12,714 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:12,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:12,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:12,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:12,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,715 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:12,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:12,715 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,715 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,715 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:12,715 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,715 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:12,815 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:12,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:12,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:12,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:12,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,827 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:12,827 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:12,827 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:12,827 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:12,827 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,827 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,849 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,849 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:12,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:12,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:12,849 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:12,849 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:12,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:12,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,850 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:12,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:12,850 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:12,850 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:12,850 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:12,851 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:12,851 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:12,851 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:12,851 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:12,851 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:13,266 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010347fe734363614018ac9c6bd348e01da2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010347fe734363614018ac9c6bd348e01da2 2023-11-10 10:54:13,675 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/f1d0636f095946c89e8a75c8a4eb979e 2023-11-10 10:54:13,682 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/f1d0636f095946c89e8a75c8a4eb979e as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f1d0636f095946c89e8a75c8a4eb979e 2023-11-10 10:54:13,688 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f1d0636f095946c89e8a75c8a4eb979e, entries=1, sequenceid=33, filesize=5.0 K 2023-11-10 10:54:13,689 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 838ms, sequenceid=33, compaction requested=true 2023-11-10 10:54:13,689 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:13,690 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:13,690 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:13,692 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,692 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:13,693 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,693 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:13,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:13,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:13,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f305479[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:13,694 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:13,694 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,695 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,695 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:13,695 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:13,695 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:13,695 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,695 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:13,696 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,696 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:13,696 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:13,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:13,696 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:13,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:13,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:13,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:13,699 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:13,699 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:13,699 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:13,699 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:13,699 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,699 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:13,700 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,700 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:13,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,700 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:13,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:13,701 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:13,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,702 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,704 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-10 10:54:13,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:13,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:13,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:13,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:13,704 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,705 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,705 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:13,705 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,705 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:13,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:13,805 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:13,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:13,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:13,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:13,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,812 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:13,812 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:13,813 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:13,813 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:13,813 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,813 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,815 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:13,815 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:13,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:13,815 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:13,815 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:13,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:13,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,816 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,817 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:13,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:13,817 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:13,817 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:13,817 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:13,817 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:13,817 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:13,817 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:13,817 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:13,817 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:14,238 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079fbd9569dfbc4d79a8c50ad5a8da496a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509079fbd9569dfbc4d79a8c50ad5a8da496a 2023-11-10 10:54:14,644 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/1f496fea156042238374ce3b0c8946e8 2023-11-10 10:54:14,652 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/1f496fea156042238374ce3b0c8946e8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/1f496fea156042238374ce3b0c8946e8 2023-11-10 10:54:14,657 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/1f496fea156042238374ce3b0c8946e8, entries=1, sequenceid=37, filesize=5.0 K 2023-11-10 10:54:14,658 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 841ms, sequenceid=37, compaction requested=true 2023-11-10 10:54:14,659 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:14,659 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:14,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:14,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:14,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:14,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:14,661 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,661 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:14,661 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,661 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:14,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:14,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:14,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:14,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d524a9c[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:14,663 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:14,663 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,664 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,664 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:14,664 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:14,664 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:14,664 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,664 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:14,665 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,665 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:14,665 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:14,665 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:14,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:14,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:14,668 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:14,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:14,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:14,668 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,668 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:14,669 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,670 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:14,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,670 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:14,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:14,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:14,670 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:14,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,672 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,673 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,673 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:14,673 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,673 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:14,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,674 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:14,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:14,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-10 10:54:14,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:14,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:14,674 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:14,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:14,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:14,774 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:14,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:14,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:14,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:14,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,781 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:14,781 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:14,781 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-10 10:54:14,781 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-10 10:54:14,781 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,781 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,782 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,782 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:14,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:14,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:14,782 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:14,782 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:14,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,783 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:14,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,783 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,783 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-10 10:54:14,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:14,783 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-10 10:54:14,783 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:14,783 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-10 10:54:14,783 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:54:14,783 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:14,784 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:14,784 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. started... 2023-11-10 10:54:14,784 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fe690bcf7d1c51ffd313a540edb9d688 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:54:15,196 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202e59a4801ac5477a91d729f211f15749 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202e59a4801ac5477a91d729f211f15749 2023-11-10 10:54:15,601 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/2f09acdf8a48403f8c69ce353981c5b0 2023-11-10 10:54:15,606 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/2f09acdf8a48403f8c69ce353981c5b0 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2f09acdf8a48403f8c69ce353981c5b0 2023-11-10 10:54:15,609 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2f09acdf8a48403f8c69ce353981c5b0, entries=1, sequenceid=41, filesize=5.0 K 2023-11-10 10:54:15,610 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe690bcf7d1c51ffd313a540edb9d688 in 826ms, sequenceid=41, compaction requested=true 2023-11-10 10:54:15,610 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:15,610 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:15,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:54:15,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:54:15,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-10 10:54:15,610 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-10 10:54:15,612 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,612 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:15,612 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,612 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:15,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:15,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-10 10:54:15,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c8b434[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:15,614 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-10 10:54:15,614 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,614 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,615 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-10 10:54:15,615 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-10 10:54:15,615 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:15,615 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,615 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:15,616 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-10 10:54:15,616 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,616 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:15,616 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-10 10:54:15,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:15,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:15,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:15,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:15,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-10 10:54:15,619 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-10 10:54:15,619 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:15,619 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:15,619 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,619 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:15,620 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,620 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:15,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,620 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:15,620 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:15,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,621 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,623 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,623 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,623 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:15,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-10 10:54:15,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:15,623 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:15,623 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,624 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:15,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:15,623 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:15,624 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:15,624 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:15,624 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,624 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,624 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:15,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:15,724 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:15,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:15,727 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:15,729 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:15,730 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:15,731 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614255731 2023-11-10 10:54:15,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:15,735 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:54:15,736 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-10 10:54:15,736 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:15,738 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x50013705 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:15,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13b24eea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:15,741 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,579 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103847b2893b0104181a0b072ca8f930b83 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103847b2893b0104181a0b072ca8f930b83 2023-11-10 10:54:16,580 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:16,591 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:16,591 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:16,597 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:16,598 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:16,606 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/adecc9ec5e93478191f406738454c84e first=Optional[r3] last=Optional[r6] 2023-11-10 10:54:16,607 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/adecc9ec5e93478191f406738454c84e}] 2023-11-10 10:54:16,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/adecc9ec5e93478191f406738454c84e for inclusion in fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:16,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-10 10:54:16,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:16,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:16,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/adecc9ec5e93478191f406738454c84e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gh879c3gg6i4dlkf0f34apbvuvo69969auigqpanup04hnd7703d1nhuhbp6jg/family1/adecc9ec5e93478191f406738454c84e 2023-11-10 10:54:16,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gh879c3gg6i4dlkf0f34apbvuvo69969auigqpanup04hnd7703d1nhuhbp6jg/family1/adecc9ec5e93478191f406738454c84e as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_ 2023-11-10 10:54:16,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gh879c3gg6i4dlkf0f34apbvuvo69969auigqpanup04hnd7703d1nhuhbp6jg/family1/adecc9ec5e93478191f406738454c84e into fe690bcf7d1c51ffd313a540edb9d688/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_ - updating store file list. 2023-11-10 10:54:16,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_ into fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:16,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gh879c3gg6i4dlkf0f34apbvuvo69969auigqpanup04hnd7703d1nhuhbp6jg/family1/adecc9ec5e93478191f406738454c84e into fe690bcf7d1c51ffd313a540edb9d688/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_) 2023-11-10 10:54:16,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gh879c3gg6i4dlkf0f34apbvuvo69969auigqpanup04hnd7703d1nhuhbp6jg/family1/adecc9ec5e93478191f406738454c84e 2023-11-10 10:54:16,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:54:16,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:54:16,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): fe690bcf7d1c51ffd313a540edb9d688/family1 is initiating minor compaction 2023-11-10 10:54:16,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1eb11fef; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:16,626 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fe690bcf7d1c51ffd313a540edb9d688/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:16,627 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/d022219db2944066a1c6ccb342278d76, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/993a99b0644f43ba9b6126a1946ca7ed, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b11b100f1a184cb085f6d252b3c882a0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6a0399cdb8044d4d92d01b461ebb2e7f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/20ae04aa6b214fc29c55b514592d6b6d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f1d0636f095946c89e8a75c8a4eb979e, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/1f496fea156042238374ce3b0c8946e8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2f09acdf8a48403f8c69ce353981c5b0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp, totalSize=50.3 K 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 2b76540e01bd4e0b8ee9fe66eae4ff6b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting d022219db2944066a1c6ccb342278d76, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 993a99b0644f43ba9b6126a1946ca7ed, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting b11b100f1a184cb085f6d252b3c882a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 6a0399cdb8044d4d92d01b461ebb2e7f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 20ae04aa6b214fc29c55b514592d6b6d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting f1d0636f095946c89e8a75c8a4eb979e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 1f496fea156042238374ce3b0c8946e8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 2f09acdf8a48403f8c69ce353981c5b0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:54:16,627 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:54:16,628 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:16,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:16,630 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228390217f6e2ac4c8d867b91af99525589 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228390217f6e2ac4c8d867b91af99525589 2023-11-10 10:54:16,631 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123197215da94a0946a0919cddd5dc1cfefd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015123197215da94a0946a0919cddd5dc1cfefd 2023-11-10 10:54:16,632 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101adfa7d4c6e0f4586b6ec8be931289b5d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101adfa7d4c6e0f4586b6ec8be931289b5d 2023-11-10 10:54:16,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010347fe734363614018ac9c6bd348e01da2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010347fe734363614018ac9c6bd348e01da2 2023-11-10 10:54:16,633 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-10 10:54:16,633 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,634 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:16,654 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): fe690bcf7d1c51ffd313a540edb9d688#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:17,475 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/f0b22337075e473eacd4dbbb04b77569 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f0b22337075e473eacd4dbbb04b77569 2023-11-10 10:54:17,480 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fe690bcf7d1c51ffd313a540edb9d688/family1 of fe690bcf7d1c51ffd313a540edb9d688 into f0b22337075e473eacd4dbbb04b77569(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:54:17,480 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:17,481 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699613656626; duration=0sec 2023-11-10 10:54:17,481 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:17,485 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a1c4b7c51f8549c7980c7977708d3836 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a1c4b7c51f8549c7980c7977708d3836 2023-11-10 10:54:17,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:17,510 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a5662b2cb03b491088c054b392360f88 first=Optional[r00] last=Optional[r2] 2023-11-10 10:54:17,510 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a5662b2cb03b491088c054b392360f88}] 2023-11-10 10:54:17,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a5662b2cb03b491088c054b392360f88 for inclusion in fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:17,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-10 10:54:17,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:17,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:17,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a5662b2cb03b491088c054b392360f88 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4dn50n97v3aifv8f15e6ia5hesh8klkionp7m5o7vj7qcr42lqufvd3m5ljtm7su/family1/a5662b2cb03b491088c054b392360f88 2023-11-10 10:54:17,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4dn50n97v3aifv8f15e6ia5hesh8klkionp7m5o7vj7qcr42lqufvd3m5ljtm7su/family1/a5662b2cb03b491088c054b392360f88 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_ 2023-11-10 10:54:17,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4dn50n97v3aifv8f15e6ia5hesh8klkionp7m5o7vj7qcr42lqufvd3m5ljtm7su/family1/a5662b2cb03b491088c054b392360f88 into fe690bcf7d1c51ffd313a540edb9d688/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_ - updating store file list. 2023-11-10 10:54:17,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_ into fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:17,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4dn50n97v3aifv8f15e6ia5hesh8klkionp7m5o7vj7qcr42lqufvd3m5ljtm7su/family1/a5662b2cb03b491088c054b392360f88 into fe690bcf7d1c51ffd313a540edb9d688/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_) 2023-11-10 10:54:17,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4dn50n97v3aifv8f15e6ia5hesh8klkionp7m5o7vj7qcr42lqufvd3m5ljtm7su/family1/a5662b2cb03b491088c054b392360f88 2023-11-10 10:54:17,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:54:17,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:54:17,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): fe690bcf7d1c51ffd313a540edb9d688/family1 is initiating minor compaction (all files) 2023-11-10 10:54:17,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2816452a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:17,524 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fe690bcf7d1c51ffd313a540edb9d688/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:17,525 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/22b95d2e4f834a16922b86b225336980, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f0b22337075e473eacd4dbbb04b77569, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp, totalSize=388.1 K 2023-11-10 10:54:17,525 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 22b95d2e4f834a16922b86b225336980, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:54:17,526 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting f0b22337075e473eacd4dbbb04b77569, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:54:17,526 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 583f177db4cc46f394efed656d2b0603_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878854600 2023-11-10 10:54:17,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:17,527 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:17,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130fcd87cce5f5f4a32814e14fe58029456 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130fcd87cce5f5f4a32814e14fe58029456 2023-11-10 10:54:17,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015eea140a7ec34d4fa586484ba03a68f8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512015eea140a7ec34d4fa586484ba03a68f8 2023-11-10 10:54:17,532 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533bbb6690c6d449cb5bff9b694047523 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120533bbb6690c6d449cb5bff9b694047523 2023-11-10 10:54:17,532 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-10 10:54:17,532 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-10 10:54:17,532 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:17,533 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:17,533 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:17,534 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:17,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8060 sec 2023-11-10 10:54:17,544 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): fe690bcf7d1c51ffd313a540edb9d688#family1#compaction#74 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:17,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/d022219db2944066a1c6ccb342278d76, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/993a99b0644f43ba9b6126a1946ca7ed, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b11b100f1a184cb085f6d252b3c882a0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6a0399cdb8044d4d92d01b461ebb2e7f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/20ae04aa6b214fc29c55b514592d6b6d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f1d0636f095946c89e8a75c8a4eb979e, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/1f496fea156042238374ce3b0c8946e8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2f09acdf8a48403f8c69ce353981c5b0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_] to archive 2023-11-10 10:54:17,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:17,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2b76540e01bd4e0b8ee9fe66eae4ff6b 2023-11-10 10:54:17,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/d022219db2944066a1c6ccb342278d76 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/d022219db2944066a1c6ccb342278d76 2023-11-10 10:54:17,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/993a99b0644f43ba9b6126a1946ca7ed to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/993a99b0644f43ba9b6126a1946ca7ed 2023-11-10 10:54:17,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b11b100f1a184cb085f6d252b3c882a0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b11b100f1a184cb085f6d252b3c882a0 2023-11-10 10:54:17,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6a0399cdb8044d4d92d01b461ebb2e7f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6a0399cdb8044d4d92d01b461ebb2e7f 2023-11-10 10:54:17,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/20ae04aa6b214fc29c55b514592d6b6d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/20ae04aa6b214fc29c55b514592d6b6d 2023-11-10 10:54:17,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f1d0636f095946c89e8a75c8a4eb979e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f1d0636f095946c89e8a75c8a4eb979e 2023-11-10 10:54:17,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/1f496fea156042238374ce3b0c8946e8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/1f496fea156042238374ce3b0c8946e8 2023-11-10 10:54:17,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2f09acdf8a48403f8c69ce353981c5b0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/2f09acdf8a48403f8c69ce353981c5b0 2023-11-10 10:54:17,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/4e0d3b8ee4fb4b999a89da1d1fb9f839_SeqId_44_ 2023-11-10 10:54:17,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-10 10:54:17,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:18,019 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:18,021 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:18,021 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:18,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-10 10:54:18,029 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE}] 2023-11-10 10:54:18,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE 2023-11-10 10:54:18,031 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:18,031 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613658031"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613658031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613658031"}]},"ts":"1699613658031"} 2023-11-10 10:54:18,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:18,185 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:18,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:18,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fe690bcf7d1c51ffd313a540edb9d688, disabling compactions & flushes 2023-11-10 10:54:18,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:18,776 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/.tmp/family1/6c68a85834d74a448f085d4aed6378f8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6c68a85834d74a448f085d4aed6378f8 2023-11-10 10:54:18,783 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fe690bcf7d1c51ffd313a540edb9d688/family1 of fe690bcf7d1c51ffd313a540edb9d688 into 6c68a85834d74a448f085d4aed6378f8(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:18,783 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:18,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:18,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:18,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. after waiting 0 ms 2023-11-10 10:54:18,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:18,783 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1699613657524; duration=1sec 2023-11-10 10:54:18,783 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:18,788 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/22b95d2e4f834a16922b86b225336980, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f0b22337075e473eacd4dbbb04b77569, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_] to archive 2023-11-10 10:54:18,789 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:18,792 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/22b95d2e4f834a16922b86b225336980 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/22b95d2e4f834a16922b86b225336980 2023-11-10 10:54:18,794 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f0b22337075e473eacd4dbbb04b77569 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/f0b22337075e473eacd4dbbb04b77569 2023-11-10 10:54:18,797 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/583f177db4cc46f394efed656d2b0603_SeqId_47_ 2023-11-10 10:54:18,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-10 10:54:18,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:18,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:18,804 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: fe690bcf7d1c51ffd313a540edb9d688 to self. 2023-11-10 10:54:18,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:18,805 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=CLOSED 2023-11-10 10:54:18,806 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613658805"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613658805"}]},"ts":"1699613658805"} 2023-11-10 10:54:18,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-10 10:54:18,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510 in 774 msec 2023-11-10 10:54:18,808 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=true 2023-11-10 10:54:18,959 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:18,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613658959"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613658959"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613658959"}]},"ts":"1699613658959"} 2023-11-10 10:54:18,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:19,114 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:19,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:19,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe690bcf7d1c51ffd313a540edb9d688, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:54:19,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:19,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,124 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,126 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:19,126 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:19,126 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe690bcf7d1c51ffd313a540edb9d688 columnFamilyName family1 2023-11-10 10:54:19,134 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6c68a85834d74a448f085d4aed6378f8 2023-11-10 10:54:19,134 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(310): Store=fe690bcf7d1c51ffd313a540edb9d688/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:19,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:19,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fe690bcf7d1c51ffd313a540edb9d688; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61198692, jitterRate=-0.08806842565536499}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:54:19,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:19,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., pid=63, masterSystemTime=1699613659114 2023-11-10 10:54:19,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:19,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:19,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:19,147 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613659147"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613659147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613659147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613659147"}]},"ts":"1699613659147"} 2023-11-10 10:54:19,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-10 10:54:19,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510 in 188 msec 2023-11-10 10:54:19,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-10 10:54:19,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE in 1.1230 sec 2023-11-10 10:54:19,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-10 10:54:19,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1290 sec 2023-11-10 10:54:19,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5490 sec 2023-11-10 10:54:19,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-10 10:54:19,159 INFO [Listener at localhost/37195] compactions.TestMobCompactor(278): alter status finished 2023-11-10 10:54:19,160 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:19,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:19,162 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:19,162 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:19,162 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614259162 2023-11-10 10:54:19,163 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:54:19,164 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-10 10:54:19,164 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:19,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x74be4f01 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:19,169 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f7bbe05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:19,169 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:19,996 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283898b86e7bec4f9a966b1f8fa3e492c7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511283898b86e7bec4f9a966b1f8fa3e492c7 2023-11-10 10:54:19,998 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:20,013 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:20,014 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:20,020 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:20,021 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:20,030 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cf7122ca32d400180a8a1f148afc174 first=Optional[r05] last=Optional[r8] 2023-11-10 10:54:20,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=51 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cf7122ca32d400180a8a1f148afc174}] 2023-11-10 10:54:20,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cf7122ca32d400180a8a1f148afc174 for inclusion in fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:20,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-10 10:54:20,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:20,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:20,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2cf7122ca32d400180a8a1f148afc174 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__q58pmqu1fspcukttf4hqggq7uv0ctlbu0qvscji62kgttt507p04ul9lm2e3i341/family1/2cf7122ca32d400180a8a1f148afc174 2023-11-10 10:54:20,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__q58pmqu1fspcukttf4hqggq7uv0ctlbu0qvscji62kgttt507p04ul9lm2e3i341/family1/2cf7122ca32d400180a8a1f148afc174 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b6d9132d2026427fa959b005f8959862_SeqId_53_ 2023-11-10 10:54:20,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__q58pmqu1fspcukttf4hqggq7uv0ctlbu0qvscji62kgttt507p04ul9lm2e3i341/family1/2cf7122ca32d400180a8a1f148afc174 into fe690bcf7d1c51ffd313a540edb9d688/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b6d9132d2026427fa959b005f8959862_SeqId_53_ - updating store file list. 2023-11-10 10:54:20,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b6d9132d2026427fa959b005f8959862_SeqId_53_ into fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:20,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__q58pmqu1fspcukttf4hqggq7uv0ctlbu0qvscji62kgttt507p04ul9lm2e3i341/family1/2cf7122ca32d400180a8a1f148afc174 into fe690bcf7d1c51ffd313a540edb9d688/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b6d9132d2026427fa959b005f8959862_SeqId_53_) 2023-11-10 10:54:20,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__q58pmqu1fspcukttf4hqggq7uv0ctlbu0qvscji62kgttt507p04ul9lm2e3i341/family1/2cf7122ca32d400180a8a1f148afc174 2023-11-10 10:54:20,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:20,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:20,055 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202e59a4801ac5477a91d729f211f15749 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511202e59a4801ac5477a91d729f211f15749 2023-11-10 10:54:20,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa2a8e6774684197aa102e2552c25b34 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128aa2a8e6774684197aa102e2552c25b34 2023-11-10 10:54:20,057 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-10 10:54:20,057 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-10 10:54:20,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:20,057 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:20,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:20,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:20,058 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:20,059 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:20,061 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 899 msec 2023-11-10 10:54:20,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-10 10:54:20,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:20,536 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-10 10:54:20,537 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:20,537 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-10 10:54:20,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-10 10:54:20,543 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE}] 2023-11-10 10:54:20,544 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE 2023-11-10 10:54:20,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:20,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613660544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613660544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613660544"}]},"ts":"1699613660544"} 2023-11-10 10:54:20,546 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:20,698 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:20,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:20,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fe690bcf7d1c51ffd313a540edb9d688, disabling compactions & flushes 2023-11-10 10:54:20,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:20,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:20,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. after waiting 0 ms 2023-11-10 10:54:20,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:20,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-10 10:54:20,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:20,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:20,713 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: fe690bcf7d1c51ffd313a540edb9d688 to self. 2023-11-10 10:54:20,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:20,716 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=CLOSED 2023-11-10 10:54:20,716 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613660716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613660716"}]},"ts":"1699613660716"} 2023-11-10 10:54:20,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-10 10:54:20,719 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510 in 171 msec 2023-11-10 10:54:20,719 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=true 2023-11-10 10:54:20,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:20,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613660870"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613660870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613660870"}]},"ts":"1699613660870"} 2023-11-10 10:54:20,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:21,027 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:21,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:21,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe690bcf7d1c51ffd313a540edb9d688, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:54:21,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:21,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,036 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,038 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:21,038 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1 2023-11-10 10:54:21,039 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe690bcf7d1c51ffd313a540edb9d688 columnFamilyName family1 2023-11-10 10:54:21,050 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/6c68a85834d74a448f085d4aed6378f8 2023-11-10 10:54:21,056 DEBUG [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/family1/b6d9132d2026427fa959b005f8959862_SeqId_53_ 2023-11-10 10:54:21,057 INFO [StoreOpener-fe690bcf7d1c51ffd313a540edb9d688-1] regionserver.HStore(310): Store=fe690bcf7d1c51ffd313a540edb9d688/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:21,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,179 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:21,179 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-10 10:54:21,179 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74be4f01 to 127.0.0.1:62972 2023-11-10 10:54:21,179 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:21,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:54:21,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fe690bcf7d1c51ffd313a540edb9d688; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71897217, jitterRate=0.071352019906044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:54:21,184 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:21,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:54:21,184 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50013705 to 127.0.0.1:62972 2023-11-10 10:54:21,185 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:21,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688., pid=69, masterSystemTime=1699613661027 2023-11-10 10:54:21,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:21,189 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:54:21,190 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=fe690bcf7d1c51ffd313a540edb9d688, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:21,190 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699613661189"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613661189"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613661189"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613661189"}]},"ts":"1699613661189"} 2023-11-10 10:54:21,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-10 10:54:21,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure fe690bcf7d1c51ffd313a540edb9d688, server=jenkins-hbase20.apache.org,43721,1699613570510 in 318 msec 2023-11-10 10:54:21,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-10 10:54:21,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=fe690bcf7d1c51ffd313a540edb9d688, REOPEN/MOVE in 649 msec 2023-11-10 10:54:21,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-10 10:54:21,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 653 msec 2023-11-10 10:54:21,196 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0700 sec 2023-11-10 10:54:21,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-10 10:54:21,198 INFO [Listener at localhost/37195] compactions.TestMobCompactor(278): alter status finished 2023-11-10 10:54:21,199 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-10 10:54:21,200 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:21,201 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:21,201 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:21,201 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614261201 2023-11-10 10:54:21,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:54:21,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-10 10:54:21,202 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:21,204 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x56a620f6 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:21,208 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2296859a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:21,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,209 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-10 10:54:21,209 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-10 10:54:21,209 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:21,210 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-10 10:54:21,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-11-10 10:54:21,256 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242 (was 253), OpenFileDescriptor=637 (was 659), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 220), ProcessCount=166 (was 166), AvailableMemoryMB=8538 (was 8864) 2023-11-10 10:54:21,268 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=166, AvailableMemoryMB=8536 2023-11-10 10:54:21,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-10 10:54:21,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:21,272 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:54:21,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-10 10:54:21,273 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:54:21,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-10 10:54:21,274 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:21,274 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd empty. 2023-11-10 10:54:21,275 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:21,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-10 10:54:21,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-10 10:54:21,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-10 10:54:21,686 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:21,688 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 922e468cc9b9b0d0832dfd4bf98934dd, NAME => 'testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:21,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-10 10:54:22,095 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:22,095 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 922e468cc9b9b0d0832dfd4bf98934dd, disabling compactions & flushes 2023-11-10 10:54:22,095 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,095 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,095 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. after waiting 0 ms 2023-11-10 10:54:22,095 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,095 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,095 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:22,098 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:54:22,100 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699613662100"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613662100"}]},"ts":"1699613662100"} 2023-11-10 10:54:22,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:54:22,102 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:54:22,102 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613662102"}]},"ts":"1699613662102"} 2023-11-10 10:54:22,103 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-10 10:54:22,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, ASSIGN}] 2023-11-10 10:54:22,107 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, ASSIGN 2023-11-10 10:54:22,107 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:22,258 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=922e468cc9b9b0d0832dfd4bf98934dd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:22,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699613662258"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613662258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613662258"}]},"ts":"1699613662258"} 2023-11-10 10:54:22,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 922e468cc9b9b0d0832dfd4bf98934dd, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:22,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-10 10:54:22,412 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:22,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 922e468cc9b9b0d0832dfd4bf98934dd, NAME => 'testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:54:22,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-10 10:54:22,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-10 10:54:22,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:22,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,421 INFO [StoreOpener-922e468cc9b9b0d0832dfd4bf98934dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,423 DEBUG [StoreOpener-922e468cc9b9b0d0832dfd4bf98934dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1 2023-11-10 10:54:22,423 DEBUG [StoreOpener-922e468cc9b9b0d0832dfd4bf98934dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1 2023-11-10 10:54:22,424 INFO [StoreOpener-922e468cc9b9b0d0832dfd4bf98934dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 922e468cc9b9b0d0832dfd4bf98934dd columnFamilyName f1 2023-11-10 10:54:22,426 INFO [StoreOpener-922e468cc9b9b0d0832dfd4bf98934dd-1] regionserver.HStore(310): Store=922e468cc9b9b0d0832dfd4bf98934dd/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:22,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:22,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:22,438 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 922e468cc9b9b0d0832dfd4bf98934dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61880270, jitterRate=-0.07791212201118469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:54:22,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:22,439 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd., pid=73, masterSystemTime=1699613662412 2023-11-10 10:54:22,441 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,441 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:22,441 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=922e468cc9b9b0d0832dfd4bf98934dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:22,442 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699613662441"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613662441"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613662441"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613662441"}]},"ts":"1699613662441"} 2023-11-10 10:54:22,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-10 10:54:22,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 922e468cc9b9b0d0832dfd4bf98934dd, server=jenkins-hbase20.apache.org,43721,1699613570510 in 184 msec 2023-11-10 10:54:22,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-10 10:54:22,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, ASSIGN in 341 msec 2023-11-10 10:54:22,449 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:54:22,449 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613662449"}]},"ts":"1699613662449"} 2023-11-10 10:54:22,450 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-10 10:54:22,452 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:54:22,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1820 sec 2023-11-10 10:54:23,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-10 10:54:23,381 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-10 10:54:23,381 DEBUG [Listener at localhost/37195] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-10 10:54:23,384 INFO [Listener at localhost/37195] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-10 10:54:23,390 INFO [Listener at localhost/37195] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-10 10:54:23,391 INFO [Listener at localhost/37195] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-10 10:54:23,391 INFO [Listener at localhost/37195] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-10 10:54:23,396 INFO [Listener at localhost/37195] regionserver.HRegion(2745): Flushing 922e468cc9b9b0d0832dfd4bf98934dd 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-10 10:54:23,811 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311105c545a52c2784ccb816e239acbddb925 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311105c545a52c2784ccb816e239acbddb925 2023-11-10 10:54:23,818 INFO [Listener at localhost/37195] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/.tmp/f1/057dfc9a08ab4f3d9860ce6734fd6332 2023-11-10 10:54:23,824 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/.tmp/f1/057dfc9a08ab4f3d9860ce6734fd6332 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332 2023-11-10 10:54:23,829 INFO [Listener at localhost/37195] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332, entries=1, sequenceid=5, filesize=4.9 K 2023-11-10 10:54:23,830 INFO [Listener at localhost/37195] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 922e468cc9b9b0d0832dfd4bf98934dd in 434ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:23,830 DEBUG [Listener at localhost/37195] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-10 10:54:23,830 DEBUG [Listener at localhost/37195] regionserver.HRegion(2446): Flush status journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:23,833 INFO [Listener at localhost/37195] regionserver.HRegion(2745): Flushing 922e468cc9b9b0d0832dfd4bf98934dd 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-10 10:54:24,255 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110c5545a49fd6a4333b2da016cf49014f1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231110c5545a49fd6a4333b2da016cf49014f1 2023-11-10 10:54:24,343 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:54:24,663 INFO [Listener at localhost/37195] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/.tmp/f1/29f5564a20ad405cafe34a311e5fdf10 2023-11-10 10:54:24,667 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/.tmp/f1/29f5564a20ad405cafe34a311e5fdf10 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10 2023-11-10 10:54:24,671 INFO [Listener at localhost/37195] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10, entries=1, sequenceid=9, filesize=4.9 K 2023-11-10 10:54:24,672 INFO [Listener at localhost/37195] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 922e468cc9b9b0d0832dfd4bf98934dd in 839ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:24,672 DEBUG [Listener at localhost/37195] regionserver.HRegion(2446): Flush status journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:24,673 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-10 10:54:24,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-10 10:54:24,675 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-10 10:54:24,675 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614264675 2023-11-10 10:54:24,675 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:24,676 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-10 10:54:24,676 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-10 10:54:24,676 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-10 10:54:24,677 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x2f7dbdfb to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:24,725 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,725 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,775 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39d157db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:24,775 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231110 for table='testGetAfterCompaction' and column='f1' 2023-11-10 10:54:24,776 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,776 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,828 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,828 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,879 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,879 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,931 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,931 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,982 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:24,982 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,034 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,034 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,085 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,085 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,136 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,136 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,188 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,188 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,239 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,239 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,291 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,291 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,342 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,342 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,393 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,393 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,444 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,444 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,496 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,496 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,547 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,547 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,598 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,598 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,617 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111052da9849a3f84444bc5bfbd58f264761 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111052da9849a3f84444bc5bfbd58f264761 2023-11-10 10:54:25,619 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testGetAfterCompaction' column='f1' 2023-11-10 10:54:25,634 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:25,635 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46340, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:25,641 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:25,643 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:25,649 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,649 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/f1/8895b3659fd14870ae046b7f6c2bd84c first=Optional[r1] last=Optional[r2] 2023-11-10 10:54:25,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{f1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/f1/8895b3659fd14870ae046b7f6c2bd84c}] 2023-11-10 10:54:25,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/f1/8895b3659fd14870ae046b7f6c2bd84c for inclusion in 922e468cc9b9b0d0832dfd4bf98934dd/f1 2023-11-10 10:54:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-10 10:54:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:54:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/f1/8895b3659fd14870ae046b7f6c2bd84c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testGetAfterCompaction__73819rgg1medj29rthtr03rnjaont9ppgbirgchsip39c44sq3pes1vb9id3je80/f1/8895b3659fd14870ae046b7f6c2bd84c 2023-11-10 10:54:25,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testGetAfterCompaction__73819rgg1medj29rthtr03rnjaont9ppgbirgchsip39c44sq3pes1vb9id3je80/f1/8895b3659fd14870ae046b7f6c2bd84c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_ 2023-11-10 10:54:25,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testGetAfterCompaction__73819rgg1medj29rthtr03rnjaont9ppgbirgchsip39c44sq3pes1vb9id3je80/f1/8895b3659fd14870ae046b7f6c2bd84c into 922e468cc9b9b0d0832dfd4bf98934dd/f1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_ - updating store file list. 2023-11-10 10:54:25,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_ into 922e468cc9b9b0d0832dfd4bf98934dd/f1 2023-11-10 10:54:25,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testGetAfterCompaction__73819rgg1medj29rthtr03rnjaont9ppgbirgchsip39c44sq3pes1vb9id3je80/f1/8895b3659fd14870ae046b7f6c2bd84c into 922e468cc9b9b0d0832dfd4bf98934dd/f1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_) 2023-11-10 10:54:25,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testGetAfterCompaction__73819rgg1medj29rthtr03rnjaont9ppgbirgchsip39c44sq3pes1vb9id3je80/f1/8895b3659fd14870ae046b7f6c2bd84c 2023-11-10 10:54:25,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): 922e468cc9b9b0d0832dfd4bf98934dd/f1 is initiating minor compaction 2023-11-10 10:54:25,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@dada400; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:25,670 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 922e468cc9b9b0d0832dfd4bf98934dd/f1 in testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:25,670 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/.tmp, totalSize=10.0 K 2023-11-10 10:54:25,670 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 29f5564a20ad405cafe34a311e5fdf10, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:54:25,670 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 168be8db68184d21826f0cd42b051c89_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:54:25,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testGetAfterCompaction' column='f1' 2023-11-10 10:54:25,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:25,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311105c545a52c2784ccb816e239acbddb925 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311105c545a52c2784ccb816e239acbddb925 2023-11-10 10:54:25,675 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231110c5545a49fd6a4333b2da016cf49014f1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231110c5545a49fd6a4333b2da016cf49014f1 2023-11-10 10:54:25,675 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-10 10:54:25,675 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231110' 2023-11-10 10:54:25,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231110 for table='testGetAfterCompaction' and column='f1' 2023-11-10 10:54:25,675 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-10 10:54:25,675 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:54:25,676 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-10 10:54:25,678 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 1.0030 sec 2023-11-10 10:54:25,680 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 922e468cc9b9b0d0832dfd4bf98934dd#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:25,700 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,700 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:25,700 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,704 DEBUG [Listener at localhost/37195] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-10 10:54:25,708 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46350, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-10 10:54:25,709 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43721] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:25,709 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-10 10:54:25,710 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-10 10:54:25,710 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43721] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-10 10:54:25,710 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43721] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. because compaction request was cancelled 2023-11-10 10:54:25,762 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,762 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:25,762 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,813 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,813 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:25,813 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,864 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,864 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:25,864 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,916 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,916 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:25,916 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,967 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:25,967 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:25,967 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,019 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,019 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,019 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,070 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,070 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,070 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,122 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,122 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,122 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,174 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,175 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,175 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,227 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,227 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,227 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,278 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,278 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,278 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,329 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,329 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,330 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,381 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,381 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,381 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,433 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,433 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,433 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,485 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,485 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,485 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,504 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/.tmp/f1/13e0cf419b834cbe8d33ee7cefd3f1d6 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/13e0cf419b834cbe8d33ee7cefd3f1d6 2023-11-10 10:54:26,508 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 922e468cc9b9b0d0832dfd4bf98934dd/f1 of 922e468cc9b9b0d0832dfd4bf98934dd into 13e0cf419b834cbe8d33ee7cefd3f1d6(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:54:26,508 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:26,508 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699613665670; duration=0sec 2023-11-10 10:54:26,508 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:26,536 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,536 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/13e0cf419b834cbe8d33ee7cefd3f1d6; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699613666492; access_time=1699613665675; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,536 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699613665608; access_time=1699613664798; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-10 10:54:26,536 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613664662; access_time=1699613663835; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_] to archive 2023-11-10 10:54:26,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:26,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/29f5564a20ad405cafe34a311e5fdf10 2023-11-10 10:54:26,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/168be8db68184d21826f0cd42b051c89_SeqId_12_ 2023-11-10 10:54:26,587 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699613663817; access_time=1699613663399; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,587 INFO [Listener at localhost/37195] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/13e0cf419b834cbe8d33ee7cefd3f1d6; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699613666492; access_time=1699613665675; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-10 10:54:26,711 INFO [Listener at localhost/37195] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-10 10:54:26,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-11-10 10:54:26,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:26,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613666725"}]},"ts":"1699613666725"} 2023-11-10 10:54:26,726 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-10 10:54:26,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-10 10:54:26,727 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-10 10:54:26,729 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, UNASSIGN}] 2023-11-10 10:54:26,730 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, UNASSIGN 2023-11-10 10:54:26,731 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=922e468cc9b9b0d0832dfd4bf98934dd, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:26,731 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699613666731"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613666731"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613666731"}]},"ts":"1699613666731"} 2023-11-10 10:54:26,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 922e468cc9b9b0d0832dfd4bf98934dd, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:26,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-10 10:54:26,883 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:26,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:26,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 922e468cc9b9b0d0832dfd4bf98934dd, disabling compactions & flushes 2023-11-10 10:54:26,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:26,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:26,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. after waiting 0 ms 2023-11-10 10:54:26,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:26,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-10 10:54:26,889 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-10 10:54:26,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd. 2023-11-10 10:54:26,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 922e468cc9b9b0d0832dfd4bf98934dd: 2023-11-10 10:54:26,891 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:26,892 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=922e468cc9b9b0d0832dfd4bf98934dd, regionState=CLOSED 2023-11-10 10:54:26,892 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699613666891"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613666891"}]},"ts":"1699613666891"} 2023-11-10 10:54:26,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-10 10:54:26,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 922e468cc9b9b0d0832dfd4bf98934dd, server=jenkins-hbase20.apache.org,43721,1699613570510 in 161 msec 2023-11-10 10:54:26,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-10 10:54:26,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=922e468cc9b9b0d0832dfd4bf98934dd, UNASSIGN in 165 msec 2023-11-10 10:54:26,896 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613666896"}]},"ts":"1699613666896"} 2023-11-10 10:54:26,897 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-10 10:54:26,898 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-10 10:54:26,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-11-10 10:54:27,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-10 10:54:27,030 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-10 10:54:27,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-11-10 10:54:27,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:27,048 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:27,049 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:27,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-10 10:54:27,052 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:27,054 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1, FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/recovered.edits] 2023-11-10 10:54:27,057 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/057dfc9a08ab4f3d9860ce6734fd6332 2023-11-10 10:54:27,058 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/13e0cf419b834cbe8d33ee7cefd3f1d6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/f1/13e0cf419b834cbe8d33ee7cefd3f1d6 2023-11-10 10:54:27,061 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/recovered.edits/15.seqid to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd/recovered.edits/15.seqid 2023-11-10 10:54:27,062 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testGetAfterCompaction/922e468cc9b9b0d0832dfd4bf98934dd 2023-11-10 10:54:27,062 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-10 10:54:27,062 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-10 10:54:27,063 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-10 10:54:27,067 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111052da9849a3f84444bc5bfbd58f264761 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023111052da9849a3f84444bc5bfbd58f264761 2023-11-10 10:54:27,067 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-10 10:54:27,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:27,089 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-10 10:54:27,091 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-10 10:54:27,092 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:27,092 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-10 10:54:27,093 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699613667092"}]},"ts":"9223372036854775807"} 2023-11-10 10:54:27,094 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-10 10:54:27,094 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 922e468cc9b9b0d0832dfd4bf98934dd, NAME => 'testGetAfterCompaction,,1699613661270.922e468cc9b9b0d0832dfd4bf98934dd.', STARTKEY => '', ENDKEY => ''}] 2023-11-10 10:54:27,094 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-10 10:54:27,094 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699613667094"}]},"ts":"9223372036854775807"} 2023-11-10 10:54:27,095 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-10 10:54:27,097 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-10 10:54:27,097 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 59 msec 2023-11-10 10:54:27,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-10 10:54:27,153 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-10 10:54:27,174 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242 (was 242), OpenFileDescriptor=626 (was 637), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 179), ProcessCount=166 (was 166), AvailableMemoryMB=8361 (was 8536) 2023-11-10 10:54:27,183 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=242, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=166, AvailableMemoryMB=8360 2023-11-10 10:54:27,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-10 10:54:27,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-10 10:54:27,187 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:54:27,187 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-10 10:54:27,188 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:54:27,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-10 10:54:27,190 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:27,190 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:27,190 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:27,190 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 empty. 2023-11-10 10:54:27,191 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 empty. 2023-11-10 10:54:27,191 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 empty. 2023-11-10 10:54:27,191 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:27,191 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:27,191 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:27,191 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-10 10:54:27,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-10 10:54:27,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-10 10:54:27,601 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:27,604 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => d597a48975b7e6b8cc15edc5c51e69d0, NAME => 'testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:27,605 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 39aed9de2af4a055694f0d6732d82764, NAME => 'testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:27,606 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => f39582ea31193f99288921c66f1414f1, NAME => 'testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:27,617 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:27,617 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing f39582ea31193f99288921c66f1414f1, disabling compactions & flushes 2023-11-10 10:54:27,617 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:27,617 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:27,617 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. after waiting 0 ms 2023-11-10 10:54:27,617 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:27,617 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:27,617 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:27,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 39aed9de2af4a055694f0d6732d82764, disabling compactions & flushes 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing d597a48975b7e6b8cc15edc5c51e69d0, disabling compactions & flushes 2023-11-10 10:54:28,017 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,017 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. after waiting 0 ms 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,017 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. after waiting 0 ms 2023-11-10 10:54:28,018 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,018 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,018 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:28,017 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,018 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:28,019 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:54:28,020 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613668020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613668020"}]},"ts":"1699613668020"} 2023-11-10 10:54:28,021 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613668020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613668020"}]},"ts":"1699613668020"} 2023-11-10 10:54:28,021 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613668020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613668020"}]},"ts":"1699613668020"} 2023-11-10 10:54:28,022 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-10 10:54:28,023 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:54:28,023 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613668023"}]},"ts":"1699613668023"} 2023-11-10 10:54:28,024 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-10 10:54:28,028 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN}] 2023-11-10 10:54:28,030 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN 2023-11-10 10:54:28,030 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN 2023-11-10 10:54:28,030 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN 2023-11-10 10:54:28,030 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:28,030 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:28,030 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:28,183 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=d597a48975b7e6b8cc15edc5c51e69d0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,183 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=39aed9de2af4a055694f0d6732d82764, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,183 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f39582ea31193f99288921c66f1414f1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,184 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613668183"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613668183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613668183"}]},"ts":"1699613668183"} 2023-11-10 10:54:28,184 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613668183"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613668183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613668183"}]},"ts":"1699613668183"} 2023-11-10 10:54:28,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613668183"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613668183"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613668183"}]},"ts":"1699613668183"} 2023-11-10 10:54:28,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure d597a48975b7e6b8cc15edc5c51e69d0, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:28,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure f39582ea31193f99288921c66f1414f1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:28,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 39aed9de2af4a055694f0d6732d82764, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:28,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-10 10:54:28,341 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:28,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f39582ea31193f99288921c66f1414f1, NAME => 'testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.', STARTKEY => '1', ENDKEY => '2'} 2023-11-10 10:54:28,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,349 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,352 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:28,352 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:28,353 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f39582ea31193f99288921c66f1414f1 columnFamilyName family1 2023-11-10 10:54:28,354 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(310): Store=f39582ea31193f99288921c66f1414f1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:28,354 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,355 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2 2023-11-10 10:54:28,355 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2 2023-11-10 10:54:28,356 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f39582ea31193f99288921c66f1414f1 columnFamilyName family2 2023-11-10 10:54:28,356 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(310): Store=f39582ea31193f99288921c66f1414f1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:28,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:28,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:28,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f39582ea31193f99288921c66f1414f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64078166, jitterRate=-0.045160919427871704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:28,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:28,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1., pid=84, masterSystemTime=1699613668341 2023-11-10 10:54:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:28,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:28,363 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d597a48975b7e6b8cc15edc5c51e69d0, NAME => 'testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.', STARTKEY => '', ENDKEY => '1'} 2023-11-10 10:54:28,363 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f39582ea31193f99288921c66f1414f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:28,363 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613668363"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613668363"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613668363"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613668363"}]},"ts":"1699613668363"} 2023-11-10 10:54:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,365 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,366 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:28,366 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:28,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-11-10 10:54:28,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure f39582ea31193f99288921c66f1414f1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 176 msec 2023-11-10 10:54:28,367 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d597a48975b7e6b8cc15edc5c51e69d0 columnFamilyName family1 2023-11-10 10:54:28,368 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(310): Store=d597a48975b7e6b8cc15edc5c51e69d0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:28,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN in 339 msec 2023-11-10 10:54:28,368 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,369 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2 2023-11-10 10:54:28,369 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2 2023-11-10 10:54:28,369 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d597a48975b7e6b8cc15edc5c51e69d0 columnFamilyName family2 2023-11-10 10:54:28,370 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(310): Store=d597a48975b7e6b8cc15edc5c51e69d0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:28,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:28,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:28,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:28,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d597a48975b7e6b8cc15edc5c51e69d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60032078, jitterRate=-0.10545232892036438}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:28,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:28,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0., pid=83, masterSystemTime=1699613668341 2023-11-10 10:54:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:28,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39aed9de2af4a055694f0d6732d82764, NAME => 'testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.', STARTKEY => '2', ENDKEY => ''} 2023-11-10 10:54:28,377 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=d597a48975b7e6b8cc15edc5c51e69d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:28,377 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613668377"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613668377"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613668377"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613668377"}]},"ts":"1699613668377"} 2023-11-10 10:54:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,378 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,380 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:28,380 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:28,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-11-10 10:54:28,380 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure d597a48975b7e6b8cc15edc5c51e69d0, server=jenkins-hbase20.apache.org,43721,1699613570510 in 192 msec 2023-11-10 10:54:28,380 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39aed9de2af4a055694f0d6732d82764 columnFamilyName family1 2023-11-10 10:54:28,381 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(310): Store=39aed9de2af4a055694f0d6732d82764/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:28,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN in 353 msec 2023-11-10 10:54:28,381 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,382 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2 2023-11-10 10:54:28,382 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2 2023-11-10 10:54:28,383 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39aed9de2af4a055694f0d6732d82764 columnFamilyName family2 2023-11-10 10:54:28,383 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(310): Store=39aed9de2af4a055694f0d6732d82764/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:28,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,384 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-10 10:54:28,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:28,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:28,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:28,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 39aed9de2af4a055694f0d6732d82764; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63495897, jitterRate=-0.053837403655052185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:28,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:28,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764., pid=85, masterSystemTime=1699613668341 2023-11-10 10:54:28,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:28,391 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=39aed9de2af4a055694f0d6732d82764, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:28,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613668391"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613668391"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613668391"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613668391"}]},"ts":"1699613668391"} 2023-11-10 10:54:28,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=82 2023-11-10 10:54:28,394 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 39aed9de2af4a055694f0d6732d82764, server=jenkins-hbase20.apache.org,43721,1699613570510 in 202 msec 2023-11-10 10:54:28,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-11-10 10:54:28,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN in 366 msec 2023-11-10 10:54:28,396 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:54:28,396 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613668396"}]},"ts":"1699613668396"} 2023-11-10 10:54:28,397 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-10 10:54:28,399 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:54:28,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2140 sec 2023-11-10 10:54:29,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-10 10:54:29,296 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-10 10:54:29,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:29,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:29,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:29,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:29,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-10 10:54:29,313 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-10 10:54:29,313 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:29,313 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-10 10:54:29,313 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-10 10:54:29,313 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:29,313 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:29,314 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:29,314 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:29,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:29,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:29,315 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:29,315 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:29,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:29,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:29,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:29,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:29,315 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-10 10:54:29,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-10 10:54:29,315 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-10 10:54:29,315 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:29,315 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-10 10:54:29,316 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:29,316 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. started... 2023-11-10 10:54:29,318 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f39582ea31193f99288921c66f1414f1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:54:29,318 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:29,318 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. started... 2023-11-10 10:54:29,318 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:29,319 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:29,319 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d597a48975b7e6b8cc15edc5c51e69d0 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:54:29,319 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:29,319 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. started... 2023-11-10 10:54:29,319 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 39aed9de2af4a055694f0d6732d82764 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:54:29,330 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f 2023-11-10 10:54:29,731 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f 2023-11-10 10:54:29,732 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 2023-11-10 10:54:29,736 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/d374402cf74349cf810156e4ad3b0e32 2023-11-10 10:54:29,739 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/5c8a6fe9b9354b00b8b2702c8d9e4071 2023-11-10 10:54:30,139 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/120cd5a76d6549338bdda6c59e25ee1a 2023-11-10 10:54:30,153 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311104826ceab427a4741bad6c393ee18b56f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104826ceab427a4741bad6c393ee18b56f 2023-11-10 10:54:30,153 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110575d62b2c936494ca700c9560da12d79 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110575d62b2c936494ca700c9560da12d79 2023-11-10 10:54:30,161 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311109f6344623fb44519af80b05a212a0495 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311109f6344623fb44519af80b05a212a0495 2023-11-10 10:54:30,559 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/e172cff307714536bb0d686bd6e2b49b 2023-11-10 10:54:30,559 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/cf252f9a20f9409788e2e320c889b7d1 2023-11-10 10:54:30,564 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/5c8a6fe9b9354b00b8b2702c8d9e4071 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071 2023-11-10 10:54:30,564 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/d374402cf74349cf810156e4ad3b0e32 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32 2023-11-10 10:54:30,565 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/36d606a02afb4aefb699061789e6c0a9 2023-11-10 10:54:30,569 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32, entries=4, sequenceid=5, filesize=5.4 K 2023-11-10 10:54:30,569 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071, entries=4, sequenceid=5, filesize=5.4 K 2023-11-10 10:54:30,569 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/120cd5a76d6549338bdda6c59e25ee1a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a 2023-11-10 10:54:30,570 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/e172cff307714536bb0d686bd6e2b49b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b 2023-11-10 10:54:30,570 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/cf252f9a20f9409788e2e320c889b7d1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1 2023-11-10 10:54:30,573 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-10 10:54:30,573 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:54:30,573 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:54:30,574 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/36d606a02afb4aefb699061789e6c0a9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9 2023-11-10 10:54:30,574 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for f39582ea31193f99288921c66f1414f1 in 1256ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:30,574 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 39aed9de2af4a055694f0d6732d82764 in 1255ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:30,574 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:30,574 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:30,574 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:30,574 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:30,574 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:30,575 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:30,577 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:54:30,578 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d597a48975b7e6b8cc15edc5c51e69d0 in 1259ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:30,578 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:30,578 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:30,578 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:30,578 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:30,578 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,578 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-10 10:54:30,579 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-10 10:54:30,580 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,580 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:30,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:30,580 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,580 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:30,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-10 10:54:30,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f01ad06[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:30,582 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-10 10:54:30,582 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,582 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-10 10:54:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-10 10:54:30,582 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:30,582 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,582 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:30,583 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-10 10:54:30,583 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,583 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:30,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:30,583 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-10 10:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:30,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:30,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-10 10:54:30,585 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-10 10:54:30,585 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:30,585 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:30,585 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-10 10:54:30,585 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:30,586 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,586 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:30,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,586 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:30,586 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,587 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:30,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:30,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:30,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-10 10:54:30,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:30,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-10 10:54:30,589 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:30,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:30,589 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:30,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:30,689 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:30,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:30,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:30,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:30,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:30,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:30,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:30,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-10 10:54:30,705 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-10 10:54:30,705 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:30,705 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-10 10:54:30,705 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-10 10:54:30,706 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,706 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:30,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,708 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:30,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:30,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:30,708 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:30,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:30,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:30,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:30,709 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-10 10:54:30,710 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-10 10:54:30,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-10 10:54:30,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-10 10:54:30,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:30,710 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-10 10:54:30,710 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:30,711 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:30,711 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. started... 2023-11-10 10:54:30,711 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. started... 2023-11-10 10:54:30,711 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d597a48975b7e6b8cc15edc5c51e69d0 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:54:30,711 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f39582ea31193f99288921c66f1414f1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:54:30,711 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:30,711 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:30,711 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:30,712 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. started... 2023-11-10 10:54:30,712 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 39aed9de2af4a055694f0d6732d82764 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:54:30,735 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 2023-11-10 10:54:31,140 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/01913545fa6c42c2913b17dd672819f8 2023-11-10 10:54:31,140 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 2023-11-10 10:54:31,141 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 2023-11-10 10:54:31,548 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/fdb0cefeab22442ea7113bb29654e1dd 2023-11-10 10:54:31,549 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/48a5a00f694341f4a6fd65c96293a691 2023-11-10 10:54:31,559 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111038bf40fdaeee41ac8035f20ef699708d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111038bf40fdaeee41ac8035f20ef699708d 2023-11-10 10:54:31,574 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110a3b24386ea9747ef8702bd84488de76d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110a3b24386ea9747ef8702bd84488de76d 2023-11-10 10:54:31,970 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/202c85ba247e4282b5413aaa1a35d3ee 2023-11-10 10:54:31,976 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311104805be3be4af403cb13cc0bdb87cf14c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104805be3be4af403cb13cc0bdb87cf14c 2023-11-10 10:54:31,977 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/01913545fa6c42c2913b17dd672819f8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8 2023-11-10 10:54:31,980 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/248519cd09784e60bc575658432088d4 2023-11-10 10:54:31,983 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8, entries=4, sequenceid=9, filesize=5.4 K 2023-11-10 10:54:31,984 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/202c85ba247e4282b5413aaa1a35d3ee as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee 2023-11-10 10:54:31,985 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/fdb0cefeab22442ea7113bb29654e1dd as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd 2023-11-10 10:54:31,987 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:54:31,988 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd, entries=4, sequenceid=9, filesize=5.4 K 2023-11-10 10:54:31,988 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 39aed9de2af4a055694f0d6732d82764 in 1276ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:31,988 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:31,988 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:31,988 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:31,988 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/248519cd09784e60bc575658432088d4 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4 2023-11-10 10:54:31,992 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:54:31,992 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d597a48975b7e6b8cc15edc5c51e69d0 in 1281ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:31,992 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:31,992 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:31,993 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:32,385 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/0b42c39d227a42a8993104198718321b 2023-11-10 10:54:32,393 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/48a5a00f694341f4a6fd65c96293a691 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691 2023-11-10 10:54:32,393 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:54:32,401 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691, entries=4, sequenceid=9, filesize=5.4 K 2023-11-10 10:54:32,402 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/0b42c39d227a42a8993104198718321b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b 2023-11-10 10:54:32,407 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:54:32,407 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for f39582ea31193f99288921c66f1414f1 in 1696ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:32,407 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:32,407 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:32,407 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:32,407 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:32,408 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,408 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-10 10:54:32,408 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-10 10:54:32,409 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,409 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:32,409 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,409 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:32,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-10 10:54:32,411 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-10 10:54:32,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@723fb903[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:32,411 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,411 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,412 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-10 10:54:32,412 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-10 10:54:32,412 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:32,412 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,412 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:32,412 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,412 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-10 10:54:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:32,412 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:32,413 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-10 10:54:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:32,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:32,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-10 10:54:32,414 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-10 10:54:32,414 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:32,414 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:32,414 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-10 10:54:32,414 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:32,415 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,415 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:32,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,415 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:32,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:32,416 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:32,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:32,418 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:32,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:32,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-10 10:54:32,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-10 10:54:32,420 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:32,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:32,420 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:32,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:32,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:32,520 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:32,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:32,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:32,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:32,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:32,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:32,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:32,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-10 10:54:32,529 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-10 10:54:32,529 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:32,530 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-10 10:54:32,530 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-10 10:54:32,530 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,530 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:32,531 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,532 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:32,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:32,532 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:32,532 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:32,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:32,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:32,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:32,533 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-10 10:54:32,534 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-10 10:54:32,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-10 10:54:32,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-10 10:54:32,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:32,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-10 10:54:32,534 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:32,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:32,534 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:32,534 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. started... 2023-11-10 10:54:32,534 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:32,534 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. started... 2023-11-10 10:54:32,534 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:32,534 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. started... 2023-11-10 10:54:32,534 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d597a48975b7e6b8cc15edc5c51e69d0 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:54:32,534 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 39aed9de2af4a055694f0d6732d82764 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:54:32,534 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f39582ea31193f99288921c66f1414f1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:54:32,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 2023-11-10 10:54:32,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b 2023-11-10 10:54:32,952 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb 2023-11-10 10:54:33,359 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/87af7dc1fe6d434884be89675c455c07 2023-11-10 10:54:33,359 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/d6d9a922b83d49b0b55fb83966d30c5d 2023-11-10 10:54:33,359 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/c181094e21d04306a6bcf095d2ef974a 2023-11-10 10:54:33,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311104c25582ca2d544b9ac64a210d60cc8b9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104c25582ca2d544b9ac64a210d60cc8b9 2023-11-10 10:54:33,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110aaed31b120f7445a9a7df44339bac6f4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110aaed31b120f7445a9a7df44339bac6f4 2023-11-10 10:54:33,787 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311108084278498de411a81d9d968ca2eef09 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311108084278498de411a81d9d968ca2eef09 2023-11-10 10:54:33,798 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/cc6058e4246a4fad97e65932420e9d2b 2023-11-10 10:54:33,801 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/d6d9a922b83d49b0b55fb83966d30c5d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d 2023-11-10 10:54:33,804 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d, entries=4, sequenceid=13, filesize=5.4 K 2023-11-10 10:54:33,805 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/cc6058e4246a4fad97e65932420e9d2b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b 2023-11-10 10:54:33,808 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:54:33,808 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d597a48975b7e6b8cc15edc5c51e69d0 in 1274ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:33,809 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:33,809 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:33,809 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:34,192 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/8940ff77d53c4858869dcef638637dab 2023-11-10 10:54:34,199 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/459bc95291de45479cfcb92ffe9bc3a7 2023-11-10 10:54:34,201 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/87af7dc1fe6d434884be89675c455c07 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07 2023-11-10 10:54:34,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/c181094e21d04306a6bcf095d2ef974a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a 2023-11-10 10:54:34,208 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07, entries=4, sequenceid=13, filesize=5.4 K 2023-11-10 10:54:34,209 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/8940ff77d53c4858869dcef638637dab as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab 2023-11-10 10:54:34,212 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a, entries=4, sequenceid=13, filesize=5.4 K 2023-11-10 10:54:34,212 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/459bc95291de45479cfcb92ffe9bc3a7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7 2023-11-10 10:54:34,214 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:54:34,215 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 39aed9de2af4a055694f0d6732d82764 in 1681ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:34,215 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:34,215 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:34,215 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:34,217 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:54:34,218 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for f39582ea31193f99288921c66f1414f1 in 1684ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:34,218 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:34,218 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-10 10:54:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-10 10:54:34,220 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,220 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:34,220 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,220 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:34,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:34,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:34,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-10 10:54:34,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d161b72[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:34,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-10 10:54:34,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-10 10:54:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-10 10:54:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:34,223 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,223 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:34,224 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-10 10:54:34,224 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:34,224 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,224 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-10 10:54:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:34,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:34,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:34,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-10 10:54:34,228 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-10 10:54:34,228 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:34,228 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:34,228 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-10 10:54:34,228 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:34,239 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,239 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,239 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:34,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:34,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:34,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,243 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:34,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:34,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,247 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,247 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:34,247 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:34,248 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:34,248 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:34,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:34,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:34,248 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:34,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-10 10:54:34,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:34,248 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,248 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,248 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:34,248 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,249 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:34,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:34,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:34,249 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:34,349 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:34,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:34,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:34,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:34,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:34,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:34,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:34,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-10 10:54:34,362 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-10 10:54:34,362 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:34,362 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-10 10:54:34,362 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-10 10:54:34,363 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,363 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:34,364 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:34,364 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:34,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:34,364 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:34,364 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:34,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:34,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:34,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:34,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:34,365 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-10 10:54:34,365 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-10 10:54:34,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-10 10:54:34,365 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-10 10:54:34,365 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:34,365 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-10 10:54:34,365 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:34,365 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:34,365 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. started... 2023-11-10 10:54:34,365 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:34,365 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:34,365 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:34,365 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f39582ea31193f99288921c66f1414f1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:54:34,365 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. started... 2023-11-10 10:54:34,365 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. started... 2023-11-10 10:54:34,366 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d597a48975b7e6b8cc15edc5c51e69d0 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:54:34,366 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 39aed9de2af4a055694f0d6732d82764 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:54:34,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c 2023-11-10 10:54:34,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 2023-11-10 10:54:34,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea 2023-11-10 10:54:34,796 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/21905665f15a4c21ba81a19f0b2c1d59 2023-11-10 10:54:34,797 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/fd3c70ef74784b1b9c37020d3170bb24 2023-11-10 10:54:35,198 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/7017b3151306491d9d82f6dc040a4729 2023-11-10 10:54:35,213 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110cc3a42f5aaee4f82b1fcbaa3d2586e98 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110cc3a42f5aaee4f82b1fcbaa3d2586e98 2023-11-10 10:54:35,213 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110007216f1c7334ac0ba6671a235c5b9d0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110007216f1c7334ac0ba6671a235c5b9d0 2023-11-10 10:54:35,218 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110e2c2c8bcddde4f2d8ac07f089922c7cf to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110e2c2c8bcddde4f2d8ac07f089922c7cf 2023-11-10 10:54:35,620 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/01a5b542544f41608d6ed249bbcc68b8 2023-11-10 10:54:35,621 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/e9b15f9d5c4243f989ff563415100ef7 2023-11-10 10:54:35,623 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/8fdc026c45f74af3b08bdd54611c8346 2023-11-10 10:54:35,628 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/fd3c70ef74784b1b9c37020d3170bb24 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24 2023-11-10 10:54:35,629 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/21905665f15a4c21ba81a19f0b2c1d59 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59 2023-11-10 10:54:35,632 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/7017b3151306491d9d82f6dc040a4729 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729 2023-11-10 10:54:35,634 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24, entries=4, sequenceid=17, filesize=5.4 K 2023-11-10 10:54:35,634 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59, entries=4, sequenceid=17, filesize=5.4 K 2023-11-10 10:54:35,636 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/e9b15f9d5c4243f989ff563415100ef7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7 2023-11-10 10:54:35,636 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/01a5b542544f41608d6ed249bbcc68b8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8 2023-11-10 10:54:35,638 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729, entries=4, sequenceid=17, filesize=5.4 K 2023-11-10 10:54:35,638 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/8fdc026c45f74af3b08bdd54611c8346 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346 2023-11-10 10:54:35,640 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:54:35,640 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:54:35,641 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for f39582ea31193f99288921c66f1414f1 in 1276ms, sequenceid=17, compaction requested=true 2023-11-10 10:54:35,641 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d597a48975b7e6b8cc15edc5c51e69d0 in 1275ms, sequenceid=17, compaction requested=true 2023-11-10 10:54:35,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:35,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:35,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:35,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:35,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:35,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:35,644 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:54:35,644 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 39aed9de2af4a055694f0d6732d82764 in 1278ms, sequenceid=17, compaction requested=true 2023-11-10 10:54:35,644 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:35,644 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:35,645 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:35,645 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:35,645 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,645 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-10 10:54:35,645 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-10 10:54:35,646 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:35,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:35,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:35,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-10 10:54:35,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbe6df0[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:35,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-10 10:54:35,648 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,649 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,649 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-10 10:54:35,649 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-10 10:54:35,649 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:35,649 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,649 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:35,650 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-10 10:54:35,650 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:35,650 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,650 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-10 10:54:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:35,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-10 10:54:35,653 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-10 10:54:35,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:35,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:35,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-10 10:54:35,653 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:35,655 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,655 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:35,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,655 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:35,656 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,657 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:35,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,661 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,661 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:35,661 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:35,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:35,661 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:35,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-10 10:54:35,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:35,661 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:35,661 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:35,662 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:35,662 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,662 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:35,662 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:35,662 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:35,662 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:35,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:35,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:35,762 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:35,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:35,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:35,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699613675782 (current time:1699613675782). 2023-11-10 10:54:35,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-10 10:54:35,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] zookeeper.ReadOnlyZKClient(139): Connect 0x2bc5105f to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:35,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d2669b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:35,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:35,795 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:35,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bc5105f to 127.0.0.1:62972 2023-11-10 10:54:35,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:35,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-10 10:54:35,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:35,804 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot, current working dir path: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/snaptb-1699613675765 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-10 10:54:35,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-10 10:54:35,813 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-10 10:54:35,814 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699614275814 2023-11-10 10:54:35,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:35,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699613675765 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-10 10:54:35,816 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-10 10:54:35,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-10 10:54:35,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 5 msec 2023-11-10 10:54:35,817 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-10 10:54:35,818 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699614275818 2023-11-10 10:54:35,820 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:35,820 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-10 10:54:35,920 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:35,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:35,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:35,925 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-10 10:54:36,125 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:36,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:36,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:36,126 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-10 10:54:36,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699613675765 2023-11-10 10:54:36,233 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699613675765' 2023-11-10 10:54:36,233 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-10 10:54:36,233 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699613675765' starting 'acquire' 2023-11-10 10:54:36,233 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699613675765', kicking off acquire phase on members. 2023-11-10 10:54:36,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,234 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699613675765 2023-11-10 10:54:36,236 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,236 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-10 10:54:36,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-10 10:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-10 10:54:36,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,237 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:36,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699613675765 2023-11-10 10:54:36,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-10 10:54:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699613675765 2023-11-10 10:54:36,239 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699613675765 from table testCompactionWithHFileLink type FLUSH 2023-11-10 10:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699613675765 2023-11-10 10:54:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699613675765' with timeout 300000ms 2023-11-10 10:54:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-10 10:54:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699613675765' starting 'acquire' stage 2023-11-10 10:54:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699613675765' locally acquired 2023-11-10 10:54:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (snaptb-1699613675765) in zk 2023-11-10 10:54:36,247 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,247 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-10 10:54:36,248 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,248 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699613675765' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699613675765 2023-11-10 10:54:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:36,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'snaptb-1699613675765' on coordinator 2023-11-10 10:54:36,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e058afc[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:36,252 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699613675765' starting 'in-barrier' execution. 2023-11-10 10:54:36,252 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,256 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,256 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699613675765' received 'reached' from coordinator. 2023-11-10 10:54:36,257 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,257 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:36,258 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:36,258 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:36,258 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:36,258 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-10 10:54:36,259 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-10 10:54:36,259 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. started... 2023-11-10 10:54:36,259 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. started... 2023-11-10 10:54:36,259 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. started... 2023-11-10 10:54:36,259 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:36,259 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:36,259 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:36,261 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.' region-info for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,261 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.' region-info for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,261 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.' region-info for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,271 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-10 10:54:36,271 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-10 10:54:36,271 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-10 10:54:36,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24] hfiles 2023-11-10 10:54:36,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729] hfiles 2023-11-10 10:54:36,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59] hfiles 2023-11-10 10:54:36,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,276 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,276 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,276 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,276 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,276 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346] hfiles 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,276 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8] hfiles 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7] hfiles 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,277 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8 for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,426 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:36,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:36,427 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-10 10:54:36,684 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. completed. 2023-11-10 10:54:36,685 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:36,686 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-10 10:54:36,688 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. completed. 2023-11-10 10:54:36,688 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:36,689 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. completed. 2023-11-10 10:54:36,689 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-10 10:54:36,689 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:36,689 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-10 10:54:36,689 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-10 10:54:36,689 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,689 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699613675765' locally completed 2023-11-10 10:54:36,690 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699613675765' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:36,692 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,692 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699613675765' has notified controller of completion 2023-11-10 10:54:36,692 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:36,693 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699613675765' completed. 2023-11-10 10:54:36,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:36,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-10 10:54:36,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:36,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:36,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699613675765 2023-11-10 10:54:36,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:36,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699613675765 2023-11-10 10:54:36,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699613675765' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:36,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'snaptb-1699613675765', counting down latch. Waiting for 0 more 2023-11-10 10:54:36,700 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699613675765' execution completed 2023-11-10 10:54:36,700 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:36,700 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:36,700 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699613675765 2023-11-10 10:54:36,700 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699613675765including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-10 10:54:36,706 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,706 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-10 10:54:36,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,706 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-10 10:54:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,707 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:36,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-10 10:54:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-10 10:54:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699613675765 2023-11-10 10:54:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699613675765 2023-11-10 10:54:36,709 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699613675765 2023-11-10 10:54:36,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699613675765 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699613675765 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699613675765/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-10 10:54:36,714 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-10 10:54:36,714 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699613675765 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-10 10:54:36,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-10 10:54:36,714 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699613675765 2023-11-10 10:54:36,715 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1699613675765 because node does not exist (not an error) 2023-11-10 10:54:36,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-10 10:54:36,715 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699613675765 2023-11-10 10:54:36,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699613675765 2023-11-10 10:54:36,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-10 10:54:36,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-10 10:54:36,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695] mob files 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 2023-11-10 10:54:36,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110007216f1c7334ac0ba6671a235c5b9d0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104805be3be4af403cb13cc0bdb87cf14c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104826ceab427a4741bad6c393ee18b56f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104c25582ca2d544b9ac64a210d60cc8b9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111038bf40fdaeee41ac8035f20ef699708d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110575d62b2c936494ca700c9560da12d79, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110aaed31b120f7445a9a7df44339bac6f4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110e2c2c8bcddde4f2d8ac07f089922c7cf, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311108084278498de411a81d9d968ca2eef09, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311109f6344623fb44519af80b05a212a0495, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110a3b24386ea9747ef8702bd84488de76d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110cc3a42f5aaee4f82b1fcbaa3d2586e98] mob files 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110007216f1c7334ac0ba6671a235c5b9d0 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104805be3be4af403cb13cc0bdb87cf14c 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104826ceab427a4741bad6c393ee18b56f 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104c25582ca2d544b9ac64a210d60cc8b9 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111038bf40fdaeee41ac8035f20ef699708d 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110575d62b2c936494ca700c9560da12d79 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110aaed31b120f7445a9a7df44339bac6f4 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110e2c2c8bcddde4f2d8ac07f089922c7cf 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311108084278498de411a81d9d968ca2eef09 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311109f6344623fb44519af80b05a212a0495 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110a3b24386ea9747ef8702bd84488de76d 2023-11-10 10:54:36,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110cc3a42f5aaee4f82b1fcbaa3d2586e98 2023-11-10 10:54:36,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699613675765 2023-11-10 10:54:36,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/snaptb-1699613675765 2023-11-10 10:54:36,928 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:36,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:36,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:36,930 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-10 10:54:37,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/snaptb-1699613675765 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/snaptb-1699613675765 2023-11-10 10:54:37,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699613675765 of table testCompactionWithHFileLink completed 2023-11-10 10:54:37,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/snaptb-1699613675765 2023-11-10 10:54:37,171 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/snaptb-1699613675765 2023-11-10 10:54:37,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699613675765 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699613675814Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699613676726 (+912 ms)Consolidate snapshot: snaptb-1699613675765 at 1699613676726Loading Region manifests for snaptb-1699613675765 at 1699613676726Writing data manifest for snaptb-1699613675765 at 1699613676735 (+9 ms)Verifying snapshot: snaptb-1699613675765 at 1699613677143 (+408 ms)Snapshot snaptb-1699613675765 of table testCompactionWithHFileLink completed at 1699613677171 (+28 ms) 2023-11-10 10:54:37,172 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-10 10:54:37,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3560 sec 2023-11-10 10:54:37,930 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:37,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:37,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-10 10:54:37,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:37,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:37,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-10 10:54:37,984 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-10 10:54:37,984 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:37,984 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-10 10:54:37,984 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-10 10:54:37,985 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:37,985 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:37,986 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:37,986 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:37,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:37,986 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:37,986 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:37,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:37,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:37,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-10 10:54:37,988 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-10 10:54:37,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-10 10:54:37,988 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-10 10:54:37,988 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:37,989 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-10 10:54:37,989 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:37,989 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:37,989 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. started... 2023-11-10 10:54:37,989 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. started... 2023-11-10 10:54:37,989 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d597a48975b7e6b8cc15edc5c51e69d0 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:54:37,989 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f39582ea31193f99288921c66f1414f1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:54:37,989 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:37,989 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:37,989 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:37,990 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. started... 2023-11-10 10:54:37,990 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 39aed9de2af4a055694f0d6732d82764 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:54:38,812 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/98a8cea1b27b4b1e980088aa77269db5 2023-11-10 10:54:38,812 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/1a53827dbc944c6fb9b5d706c6f5c33f 2023-11-10 10:54:38,813 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/23c4ba3347d2488280c6671ca37e3cd0 2023-11-10 10:54:38,822 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98a8cea1b27b4b1e980088aa77269db5 2023-11-10 10:54:38,822 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a53827dbc944c6fb9b5d706c6f5c33f 2023-11-10 10:54:38,823 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23c4ba3347d2488280c6671ca37e3cd0 2023-11-10 10:54:39,641 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/a2962ccea69041a0a5822a35d0e9567f 2023-11-10 10:54:39,642 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/13e99a4e3815408bafec38cba7764d26 2023-11-10 10:54:39,642 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/23d7e41e6cbb4a84904a19a578e98e1c 2023-11-10 10:54:39,646 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2962ccea69041a0a5822a35d0e9567f 2023-11-10 10:54:39,646 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13e99a4e3815408bafec38cba7764d26 2023-11-10 10:54:39,646 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23d7e41e6cbb4a84904a19a578e98e1c 2023-11-10 10:54:39,646 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/23c4ba3347d2488280c6671ca37e3cd0 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/23c4ba3347d2488280c6671ca37e3cd0 2023-11-10 10:54:39,647 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/98a8cea1b27b4b1e980088aa77269db5 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/98a8cea1b27b4b1e980088aa77269db5 2023-11-10 10:54:39,647 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/1a53827dbc944c6fb9b5d706c6f5c33f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/1a53827dbc944c6fb9b5d706c6f5c33f 2023-11-10 10:54:39,650 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a53827dbc944c6fb9b5d706c6f5c33f 2023-11-10 10:54:39,650 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98a8cea1b27b4b1e980088aa77269db5 2023-11-10 10:54:39,650 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/1a53827dbc944c6fb9b5d706c6f5c33f, entries=3, sequenceid=24, filesize=5.0 K 2023-11-10 10:54:39,650 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/98a8cea1b27b4b1e980088aa77269db5, entries=3, sequenceid=24, filesize=5.0 K 2023-11-10 10:54:39,650 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23c4ba3347d2488280c6671ca37e3cd0 2023-11-10 10:54:39,650 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/23c4ba3347d2488280c6671ca37e3cd0, entries=3, sequenceid=24, filesize=5.0 K 2023-11-10 10:54:39,650 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/13e99a4e3815408bafec38cba7764d26 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/13e99a4e3815408bafec38cba7764d26 2023-11-10 10:54:39,650 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/23d7e41e6cbb4a84904a19a578e98e1c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/23d7e41e6cbb4a84904a19a578e98e1c 2023-11-10 10:54:39,650 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/a2962ccea69041a0a5822a35d0e9567f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/a2962ccea69041a0a5822a35d0e9567f 2023-11-10 10:54:39,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23d7e41e6cbb4a84904a19a578e98e1c 2023-11-10 10:54:39,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2962ccea69041a0a5822a35d0e9567f 2023-11-10 10:54:39,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 13e99a4e3815408bafec38cba7764d26 2023-11-10 10:54:39,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/a2962ccea69041a0a5822a35d0e9567f, entries=1, sequenceid=24, filesize=5.0 K 2023-11-10 10:54:39,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/23d7e41e6cbb4a84904a19a578e98e1c, entries=1, sequenceid=24, filesize=5.0 K 2023-11-10 10:54:39,654 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/13e99a4e3815408bafec38cba7764d26, entries=1, sequenceid=24, filesize=5.0 K 2023-11-10 10:54:39,655 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for f39582ea31193f99288921c66f1414f1 in 1666ms, sequenceid=24, compaction requested=true 2023-11-10 10:54:39,655 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 39aed9de2af4a055694f0d6732d82764 in 1665ms, sequenceid=24, compaction requested=true 2023-11-10 10:54:39,655 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:39,655 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:39,655 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d597a48975b7e6b8cc15edc5c51e69d0 in 1666ms, sequenceid=24, compaction requested=true 2023-11-10 10:54:39,655 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:39,655 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:39,655 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:39,655 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-10 10:54:39,655 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-10 10:54:39,656 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,656 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:39,657 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,657 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:39,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-10 10:54:39,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@417dd59e[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:39,658 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-10 10:54:39,658 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,658 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-10 10:54:39,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-10 10:54:39,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:39,659 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,659 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:39,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-10 10:54:39,659 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:39,660 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:39,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:39,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:39,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-10 10:54:39,662 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-10 10:54:39,662 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:39,662 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:39,662 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-10 10:54:39,662 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:39,663 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,663 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:39,663 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,663 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:39,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:39,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:39,664 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-10 10:54:39,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,666 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,666 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:39,666 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:39,666 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-10 10:54:39,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:39,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-10 10:54:39,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-10 10:54:39,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:39,666 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:39,666 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:39,666 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:39,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:39,667 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,667 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-10 10:54:39,667 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-10 10:54:39,667 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:39,667 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:39,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:39,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:39,767 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:39,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:39,769 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:39,769 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): f39582ea31193f99288921c66f1414f1/family1 is initiating major compaction (all files) 2023-11-10 10:54:39,769 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:54:39,769 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:54:39,770 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of f39582ea31193f99288921c66f1414f1/family1 in testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:39,770 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/1a53827dbc944c6fb9b5d706c6f5c33f] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp, totalSize=26.7 K 2023-11-10 10:54:39,771 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting d374402cf74349cf810156e4ad3b0e32, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669307 2023-11-10 10:54:39,771 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 48a5a00f694341f4a6fd65c96293a691, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:39,772 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting c181094e21d04306a6bcf095d2ef974a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:39,773 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting fd3c70ef74784b1b9c37020d3170bb24, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:39,774 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 1a53827dbc944c6fb9b5d706c6f5c33f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-10 10:54:39,793 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): f39582ea31193f99288921c66f1414f1#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:40,205 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del 2023-11-10 10:54:40,205 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del 2023-11-10 10:54:41,030 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b1bf464526c4beda7496f8c89dc2490 2023-11-10 10:54:41,031 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/7b1bf464526c4beda7496f8c89dc2490 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/7b1bf464526c4beda7496f8c89dc2490 2023-11-10 10:54:41,037 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b1bf464526c4beda7496f8c89dc2490 2023-11-10 10:54:41,038 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f39582ea31193f99288921c66f1414f1/family1 of f39582ea31193f99288921c66f1414f1 into 7b1bf464526c4beda7496f8c89dc2490(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:41,039 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:41,039 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:41,039 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): f39582ea31193f99288921c66f1414f1/family2 is initiating major compaction (all files) 2023-11-10 10:54:41,039 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:54:41,039 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:54:41,039 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of f39582ea31193f99288921c66f1414f1/family2 in testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:41,039 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/23d7e41e6cbb4a84904a19a578e98e1c] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp, totalSize=25.4 K 2023-11-10 10:54:41,040 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting e172cff307714536bb0d686bd6e2b49b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669307 2023-11-10 10:54:41,040 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 0b42c39d227a42a8993104198718321b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:41,041 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 459bc95291de45479cfcb92ffe9bc3a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:41,041 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting e9b15f9d5c4243f989ff563415100ef7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:41,042 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 23d7e41e6cbb4a84904a19a578e98e1c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-10 10:54:41,057 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): f39582ea31193f99288921c66f1414f1#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:41,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/1a53827dbc944c6fb9b5d706c6f5c33f] to archive 2023-11-10 10:54:41,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:41,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/d374402cf74349cf810156e4ad3b0e32 2023-11-10 10:54:41,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/48a5a00f694341f4a6fd65c96293a691 2023-11-10 10:54:41,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/c181094e21d04306a6bcf095d2ef974a 2023-11-10 10:54:41,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/fd3c70ef74784b1b9c37020d3170bb24 2023-11-10 10:54:41,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/1a53827dbc944c6fb9b5d706c6f5c33f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/1a53827dbc944c6fb9b5d706c6f5c33f 2023-11-10 10:54:41,469 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del 2023-11-10 10:54:41,469 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del 2023-11-10 10:54:42,294 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ad63d4b1ab74bdebc7286bd99e252d6 2023-11-10 10:54:42,295 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/8ad63d4b1ab74bdebc7286bd99e252d6 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/8ad63d4b1ab74bdebc7286bd99e252d6 2023-11-10 10:54:42,300 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ad63d4b1ab74bdebc7286bd99e252d6 2023-11-10 10:54:42,301 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in f39582ea31193f99288921c66f1414f1/family2 of f39582ea31193f99288921c66f1414f1 into 8ad63d4b1ab74bdebc7286bd99e252d6(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:42,301 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:42,301 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:42,301 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): d597a48975b7e6b8cc15edc5c51e69d0/family1 is initiating major compaction (all files) 2023-11-10 10:54:42,302 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:54:42,302 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:54:42,302 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of d597a48975b7e6b8cc15edc5c51e69d0/family1 in testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:42,302 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/98a8cea1b27b4b1e980088aa77269db5] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp, totalSize=26.7 K 2023-11-10 10:54:42,303 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 120cd5a76d6549338bdda6c59e25ee1a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669306 2023-11-10 10:54:42,303 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting fdb0cefeab22442ea7113bb29654e1dd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670694 2023-11-10 10:54:42,304 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting d6d9a922b83d49b0b55fb83966d30c5d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:42,304 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 21905665f15a4c21ba81a19f0b2c1d59, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674353 2023-11-10 10:54:42,305 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 98a8cea1b27b4b1e980088aa77269db5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-10 10:54:42,318 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): d597a48975b7e6b8cc15edc5c51e69d0#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:42,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/23d7e41e6cbb4a84904a19a578e98e1c] to archive 2023-11-10 10:54:42,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:42,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e172cff307714536bb0d686bd6e2b49b 2023-11-10 10:54:42,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/0b42c39d227a42a8993104198718321b 2023-11-10 10:54:42,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/459bc95291de45479cfcb92ffe9bc3a7 2023-11-10 10:54:42,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/e9b15f9d5c4243f989ff563415100ef7 2023-11-10 10:54:42,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/23d7e41e6cbb4a84904a19a578e98e1c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/23d7e41e6cbb4a84904a19a578e98e1c 2023-11-10 10:54:42,731 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del 2023-11-10 10:54:42,731 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del 2023-11-10 10:54:43,561 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69f375b05df54cfeae1231725a9ec4c5 2023-11-10 10:54:43,562 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/69f375b05df54cfeae1231725a9ec4c5 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/69f375b05df54cfeae1231725a9ec4c5 2023-11-10 10:54:43,566 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69f375b05df54cfeae1231725a9ec4c5 2023-11-10 10:54:43,567 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d597a48975b7e6b8cc15edc5c51e69d0/family1 of d597a48975b7e6b8cc15edc5c51e69d0 into 69f375b05df54cfeae1231725a9ec4c5(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:43,567 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:43,568 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:43,568 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): d597a48975b7e6b8cc15edc5c51e69d0/family2 is initiating major compaction (all files) 2023-11-10 10:54:43,568 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:54:43,568 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:54:43,568 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of d597a48975b7e6b8cc15edc5c51e69d0/family2 in testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:43,568 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/13e99a4e3815408bafec38cba7764d26] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp, totalSize=25.4 K 2023-11-10 10:54:43,569 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 36d606a02afb4aefb699061789e6c0a9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669306 2023-11-10 10:54:43,569 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 248519cd09784e60bc575658432088d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670694 2023-11-10 10:54:43,569 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting cc6058e4246a4fad97e65932420e9d2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:43,570 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 01a5b542544f41608d6ed249bbcc68b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674353 2023-11-10 10:54:43,570 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 13e99a4e3815408bafec38cba7764d26, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-10 10:54:43,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/98a8cea1b27b4b1e980088aa77269db5] to archive 2023-11-10 10:54:43,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:43,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/120cd5a76d6549338bdda6c59e25ee1a 2023-11-10 10:54:43,583 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): d597a48975b7e6b8cc15edc5c51e69d0#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:43,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/fdb0cefeab22442ea7113bb29654e1dd 2023-11-10 10:54:43,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/d6d9a922b83d49b0b55fb83966d30c5d 2023-11-10 10:54:43,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/21905665f15a4c21ba81a19f0b2c1d59 2023-11-10 10:54:43,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/98a8cea1b27b4b1e980088aa77269db5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/98a8cea1b27b4b1e980088aa77269db5 2023-11-10 10:54:43,590 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del 2023-11-10 10:54:43,590 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del 2023-11-10 10:54:44,414 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6de704529944b9cbe68c19a43978448 2023-11-10 10:54:44,415 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/f6de704529944b9cbe68c19a43978448 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/f6de704529944b9cbe68c19a43978448 2023-11-10 10:54:44,421 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6de704529944b9cbe68c19a43978448 2023-11-10 10:54:44,422 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d597a48975b7e6b8cc15edc5c51e69d0/family2 of d597a48975b7e6b8cc15edc5c51e69d0 into f6de704529944b9cbe68c19a43978448(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:54:44,422 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:44,422 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:44,422 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 39aed9de2af4a055694f0d6732d82764/family1 is initiating major compaction (all files) 2023-11-10 10:54:44,422 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:54:44,422 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:54:44,422 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 39aed9de2af4a055694f0d6732d82764/family1 in testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:44,422 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/23c4ba3347d2488280c6671ca37e3cd0] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp, totalSize=26.7 K 2023-11-10 10:54:44,423 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 5c8a6fe9b9354b00b8b2702c8d9e4071, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669308 2023-11-10 10:54:44,424 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 01913545fa6c42c2913b17dd672819f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:44,424 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 87af7dc1fe6d434884be89675c455c07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:44,425 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 7017b3151306491d9d82f6dc040a4729, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:44,425 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 23c4ba3347d2488280c6671ca37e3cd0, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-10 10:54:44,438 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 39aed9de2af4a055694f0d6732d82764#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:44,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/13e99a4e3815408bafec38cba7764d26] to archive 2023-11-10 10:54:44,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:44,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/36d606a02afb4aefb699061789e6c0a9 2023-11-10 10:54:44,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/248519cd09784e60bc575658432088d4 2023-11-10 10:54:44,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/cc6058e4246a4fad97e65932420e9d2b 2023-11-10 10:54:44,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/01a5b542544f41608d6ed249bbcc68b8 2023-11-10 10:54:44,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/13e99a4e3815408bafec38cba7764d26 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/13e99a4e3815408bafec38cba7764d26 2023-11-10 10:54:44,851 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del 2023-11-10 10:54:44,852 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del 2023-11-10 10:54:45,677 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1647f0395034882b191996a690a30a4 2023-11-10 10:54:45,679 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/e1647f0395034882b191996a690a30a4 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/e1647f0395034882b191996a690a30a4 2023-11-10 10:54:45,686 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e1647f0395034882b191996a690a30a4 2023-11-10 10:54:45,687 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 39aed9de2af4a055694f0d6732d82764/family1 of 39aed9de2af4a055694f0d6732d82764 into e1647f0395034882b191996a690a30a4(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:45,687 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:45,687 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:45,687 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 39aed9de2af4a055694f0d6732d82764/family2 is initiating major compaction (all files) 2023-11-10 10:54:45,687 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:54:45,687 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:54:45,688 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 39aed9de2af4a055694f0d6732d82764/family2 in testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:45,688 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/a2962ccea69041a0a5822a35d0e9567f] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp, totalSize=25.4 K 2023-11-10 10:54:45,688 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting cf252f9a20f9409788e2e320c889b7d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669308 2023-11-10 10:54:45,689 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 202c85ba247e4282b5413aaa1a35d3ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:45,689 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 8940ff77d53c4858869dcef638637dab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:45,690 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 8fdc026c45f74af3b08bdd54611c8346, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:45,690 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting a2962ccea69041a0a5822a35d0e9567f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-10 10:54:45,701 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 39aed9de2af4a055694f0d6732d82764#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:45,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/23c4ba3347d2488280c6671ca37e3cd0] to archive 2023-11-10 10:54:45,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:45,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/5c8a6fe9b9354b00b8b2702c8d9e4071 2023-11-10 10:54:45,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/01913545fa6c42c2913b17dd672819f8 2023-11-10 10:54:45,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/87af7dc1fe6d434884be89675c455c07 2023-11-10 10:54:45,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/7017b3151306491d9d82f6dc040a4729 2023-11-10 10:54:45,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/23c4ba3347d2488280c6671ca37e3cd0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/23c4ba3347d2488280c6671ca37e3cd0 2023-11-10 10:54:46,109 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del 2023-11-10 10:54:46,109 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del 2023-11-10 10:54:46,937 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f2fc503b1044524a84355b3863dbc49 2023-11-10 10:54:46,938 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/7f2fc503b1044524a84355b3863dbc49 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/7f2fc503b1044524a84355b3863dbc49 2023-11-10 10:54:46,944 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f2fc503b1044524a84355b3863dbc49 2023-11-10 10:54:46,945 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 39aed9de2af4a055694f0d6732d82764/family2 of 39aed9de2af4a055694f0d6732d82764 into 7f2fc503b1044524a84355b3863dbc49(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:46,945 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:46,951 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:46,955 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:46,960 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:46,961 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:46,967 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-10 10:54:46,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/a2962ccea69041a0a5822a35d0e9567f] to archive 2023-11-10 10:54:46,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:46,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/cf252f9a20f9409788e2e320c889b7d1 2023-11-10 10:54:46,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/202c85ba247e4282b5413aaa1a35d3ee 2023-11-10 10:54:46,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8940ff77d53c4858869dcef638637dab 2023-11-10 10:54:46,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/8fdc026c45f74af3b08bdd54611c8346 2023-11-10 10:54:46,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/a2962ccea69041a0a5822a35d0e9567f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/a2962ccea69041a0a5822a35d0e9567f 2023-11-10 10:54:47,001 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-10 10:54:47,004 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del 2023-11-10 10:54:47,008 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del 2023-11-10 10:54:47,012 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del 2023-11-10 10:54:47,012 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,014 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(139): Connect 0x29ed93a2 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:47,019 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@748a9fe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:47,020 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,020 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,020 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,088 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110fdeaea1b5287438a894bd52405c423e4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110fdeaea1b5287438a894bd52405c423e4 2023-11-10 10:54:47,089 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,101 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:47,104 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:47,111 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:47,114 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:47,123 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/b2696b0f04bc47a6b9ccf327bc2228d4 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-10 10:54:47,124 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/b2696b0f04bc47a6b9ccf327bc2228d4}] 2023-11-10 10:54:47,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/b2696b0f04bc47a6b9ccf327bc2228d4 for inclusion in 39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-10 10:54:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-10 10:54:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:47,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/b2696b0f04bc47a6b9ccf327bc2228d4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__jo95em1229ffdlkd0aeml8nkvkc38uua4n0pq7099vct02njgsltb7fmb4t38jss/family1/b2696b0f04bc47a6b9ccf327bc2228d4 2023-11-10 10:54:47,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__jo95em1229ffdlkd0aeml8nkvkc38uua4n0pq7099vct02njgsltb7fmb4t38jss/family1/b2696b0f04bc47a6b9ccf327bc2228d4 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_ 2023-11-10 10:54:47,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__jo95em1229ffdlkd0aeml8nkvkc38uua4n0pq7099vct02njgsltb7fmb4t38jss/family1/b2696b0f04bc47a6b9ccf327bc2228d4 into 39aed9de2af4a055694f0d6732d82764/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_ - updating store file list. 2023-11-10 10:54:47,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_ into 39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:47,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__jo95em1229ffdlkd0aeml8nkvkc38uua4n0pq7099vct02njgsltb7fmb4t38jss/family1/b2696b0f04bc47a6b9ccf327bc2228d4 into 39aed9de2af4a055694f0d6732d82764/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_) 2023-11-10 10:54:47,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__jo95em1229ffdlkd0aeml8nkvkc38uua4n0pq7099vct02njgsltb7fmb4t38jss/family1/b2696b0f04bc47a6b9ccf327bc2228d4 2023-11-10 10:54:47,139 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,140 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:47,141 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c 2023-11-10 10:54:47,141 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f 2023-11-10 10:54:47,142 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b 2023-11-10 10:54:47,143 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 2023-11-10 10:54:47,143 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-10 10:54:47,143 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110' 2023-11-10 10:54:47,143 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,499 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110e80a07453a434b6397c8a16b3d454c16 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110e80a07453a434b6397c8a16b3d454c16 2023-11-10 10:54:47,501 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,505 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110fc802f49902f4ca1a7a5716d669ff086 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110fc802f49902f4ca1a7a5716d669ff086 2023-11-10 10:54:47,507 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,537 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/adb6c97070f64582a4142a93e3ec7f72 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-10 10:54:47,545 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/adb6c97070f64582a4142a93e3ec7f72}] 2023-11-10 10:54:47,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/adb6c97070f64582a4142a93e3ec7f72 for inclusion in f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:47,547 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/05e55e007ddc4c2896fa96bac198c0b9 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-10 10:54:47,548 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/05e55e007ddc4c2896fa96bac198c0b9}] 2023-11-10 10:54:47,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/05e55e007ddc4c2896fa96bac198c0b9 for inclusion in d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:47,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-10 10:54:47,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-10 10:54:47,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:47,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/adb6c97070f64582a4142a93e3ec7f72 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__gsgvacoose7sum7ntp0hr0kqs0uehvsph16agkcn5jv9c0nerjkmf9s4ooi6g1q2/family1/adb6c97070f64582a4142a93e3ec7f72 2023-11-10 10:54:47,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-10 10:54:47,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last=1 2023-11-10 10:54:47,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:47,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/05e55e007ddc4c2896fa96bac198c0b9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__d5sv6pl67mi3mr0uo30okm2fecknbtqs86b46tls4jrkapqv12c7bl5ruob1uu1i/family1/05e55e007ddc4c2896fa96bac198c0b9 2023-11-10 10:54:47,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__gsgvacoose7sum7ntp0hr0kqs0uehvsph16agkcn5jv9c0nerjkmf9s4ooi6g1q2/family1/adb6c97070f64582a4142a93e3ec7f72 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_ 2023-11-10 10:54:47,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__gsgvacoose7sum7ntp0hr0kqs0uehvsph16agkcn5jv9c0nerjkmf9s4ooi6g1q2/family1/adb6c97070f64582a4142a93e3ec7f72 into f39582ea31193f99288921c66f1414f1/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_ - updating store file list. 2023-11-10 10:54:47,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__d5sv6pl67mi3mr0uo30okm2fecknbtqs86b46tls4jrkapqv12c7bl5ruob1uu1i/family1/05e55e007ddc4c2896fa96bac198c0b9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_ 2023-11-10 10:54:47,555 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__d5sv6pl67mi3mr0uo30okm2fecknbtqs86b46tls4jrkapqv12c7bl5ruob1uu1i/family1/05e55e007ddc4c2896fa96bac198c0b9 into d597a48975b7e6b8cc15edc5c51e69d0/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_ - updating store file list. 2023-11-10 10:54:47,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_ into f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:47,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__gsgvacoose7sum7ntp0hr0kqs0uehvsph16agkcn5jv9c0nerjkmf9s4ooi6g1q2/family1/adb6c97070f64582a4142a93e3ec7f72 into f39582ea31193f99288921c66f1414f1/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_) 2023-11-10 10:54:47,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__gsgvacoose7sum7ntp0hr0kqs0uehvsph16agkcn5jv9c0nerjkmf9s4ooi6g1q2/family1/adb6c97070f64582a4142a93e3ec7f72 2023-11-10 10:54:47,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_ into d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:47,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__d5sv6pl67mi3mr0uo30okm2fecknbtqs86b46tls4jrkapqv12c7bl5ruob1uu1i/family1/05e55e007ddc4c2896fa96bac198c0b9 into d597a48975b7e6b8cc15edc5c51e69d0/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_) 2023-11-10 10:54:47,558 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__d5sv6pl67mi3mr0uo30okm2fecknbtqs86b46tls4jrkapqv12c7bl5ruob1uu1i/family1/05e55e007ddc4c2896fa96bac198c0b9 2023-11-10 10:54:47,559 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:47,559 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,560 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 2023-11-10 10:54:47,560 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:47,560 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea 2023-11-10 10:54:47,561 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 2023-11-10 10:54:47,561 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f 2023-11-10 10:54:47,562 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 2023-11-10 10:54:47,562 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb 2023-11-10 10:54:47,562 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-10 10:54:47,562 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110' 2023-11-10 10:54:47,562 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 2023-11-10 10:54:47,562 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,563 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 2023-11-10 10:54:47,563 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-10 10:54:47,563 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110' 2023-11-10 10:54:47,563 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,563 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:47,563 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:47,564 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del] 2023-11-10 10:54:47,564 DEBUG [Listener at localhost/37195] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:47,565 DEBUG [Listener at localhost/37195] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311107b5b3040c29d4d1abbf9aae812a42895_del 2023-11-10 10:54:47,565 INFO [Listener at localhost/37195] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-10 10:54:47,565 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del] 2023-11-10 10:54:47,565 DEBUG [Listener at localhost/37195] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:47,566 DEBUG [Listener at localhost/37195] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311106edca79c31e74d4d958faee3a3a35d2f_del 2023-11-10 10:54:47,566 INFO [Listener at localhost/37195] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-10 10:54:47,566 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del] 2023-11-10 10:54:47,566 DEBUG [Listener at localhost/37195] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:47,567 DEBUG [Listener at localhost/37195] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311106739bc3d3a454b00bf7fb6bdae29e7a5_del 2023-11-10 10:54:47,567 INFO [Listener at localhost/37195] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-10 10:54:47,570 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:47,572 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:47,575 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:47,576 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:47,583 INFO [Listener at localhost/37195] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-10 10:54:47,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-11-10 10:54:47,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-10 10:54:47,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-10 10:54:47,586 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613687586"}]},"ts":"1699613687586"} 2023-11-10 10:54:47,587 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-10 10:54:47,588 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-10 10:54:47,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, UNASSIGN}] 2023-11-10 10:54:47,590 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, UNASSIGN 2023-11-10 10:54:47,590 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, UNASSIGN 2023-11-10 10:54:47,590 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, UNASSIGN 2023-11-10 10:54:47,591 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=f39582ea31193f99288921c66f1414f1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:47,591 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=d597a48975b7e6b8cc15edc5c51e69d0, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:47,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=39aed9de2af4a055694f0d6732d82764, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:47,591 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613687591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613687591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613687591"}]},"ts":"1699613687591"} 2023-11-10 10:54:47,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613687591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613687591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613687591"}]},"ts":"1699613687591"} 2023-11-10 10:54:47,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613687591"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613687591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613687591"}]},"ts":"1699613687591"} 2023-11-10 10:54:47,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure f39582ea31193f99288921c66f1414f1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:47,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure d597a48975b7e6b8cc15edc5c51e69d0, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:47,593 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 39aed9de2af4a055694f0d6732d82764, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:47,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-10 10:54:47,743 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:47,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:47,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 39aed9de2af4a055694f0d6732d82764, disabling compactions & flushes 2023-11-10 10:54:47,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:47,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:47,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. after waiting 0 ms 2023-11-10 10:54:47,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:47,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-10 10:54:47,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:47,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:47,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:47,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:47,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f39582ea31193f99288921c66f1414f1, disabling compactions & flushes 2023-11-10 10:54:47,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:47,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:47,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. after waiting 0 ms 2023-11-10 10:54:47,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:47,753 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=39aed9de2af4a055694f0d6732d82764, regionState=CLOSED 2023-11-10 10:54:47,754 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613687753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613687753"}]},"ts":"1699613687753"} 2023-11-10 10:54:47,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-11-10 10:54:47,757 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 39aed9de2af4a055694f0d6732d82764, server=jenkins-hbase20.apache.org,43721,1699613570510 in 162 msec 2023-11-10 10:54:47,757 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-10 10:54:47,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, UNASSIGN in 168 msec 2023-11-10 10:54:47,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:47,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:47,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:47,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:47,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d597a48975b7e6b8cc15edc5c51e69d0, disabling compactions & flushes 2023-11-10 10:54:47,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:47,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:47,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. after waiting 0 ms 2023-11-10 10:54:47,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:47,760 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=f39582ea31193f99288921c66f1414f1, regionState=CLOSED 2023-11-10 10:54:47,760 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613687760"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613687760"}]},"ts":"1699613687760"} 2023-11-10 10:54:47,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-11-10 10:54:47,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure f39582ea31193f99288921c66f1414f1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 169 msec 2023-11-10 10:54:47,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, UNASSIGN in 173 msec 2023-11-10 10:54:47,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-10 10:54:47,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:47,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:47,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:47,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=d597a48975b7e6b8cc15edc5c51e69d0, regionState=CLOSED 2023-11-10 10:54:47,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613687766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613687766"}]},"ts":"1699613687766"} 2023-11-10 10:54:47,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-10 10:54:47,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure d597a48975b7e6b8cc15edc5c51e69d0, server=jenkins-hbase20.apache.org,43721,1699613570510 in 175 msec 2023-11-10 10:54:47,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-11-10 10:54:47,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, UNASSIGN in 179 msec 2023-11-10 10:54:47,769 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613687769"}]},"ts":"1699613687769"} 2023-11-10 10:54:47,770 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-10 10:54:47,771 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-10 10:54:47,773 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 189 msec 2023-11-10 10:54:47,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-10 10:54:47,891 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-10 10:54:47,907 INFO [Listener at localhost/37195] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:47,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699613687908 (current time:1699613687908). 2023-11-10 10:54:47,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-10 10:54:47,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] zookeeper.ReadOnlyZKClient(139): Connect 0x5bf2fba8 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:47,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@119cc452, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:47,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:47,915 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:47,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bf2fba8 to 127.0.0.1:62972 2023-11-10 10:54:47,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:47,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-10 10:54:47,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:47,919 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot, current working dir path: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699613675765-1699613687907 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-10 10:54:47,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-10 10:54:47,922 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-10 10:54:47,923 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699614287923 2023-11-10 10:54:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:47,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699613675765-1699613687907 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-10 10:54:47,923 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:47,923 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-10 10:54:48,023 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:48,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:48,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:48,026 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-10 10:54:48,226 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:48,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:48,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:48,229 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-10 10:54:48,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-10 10:54:48,337 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-10 10:54:48,336 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/69f375b05df54cfeae1231725a9ec4c5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_] hfiles 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/e1647f0395034882b191996a690a30a4] hfiles 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/7b1bf464526c4beda7496f8c89dc2490] hfiles 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_ 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/69f375b05df54cfeae1231725a9ec4c5 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/e1647f0395034882b191996a690a30a4 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_ 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110e80a07453a434b6397c8a16b3d454c16, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110fdeaea1b5287438a894bd52405c423e4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110fc802f49902f4ca1a7a5716d669ff086] hfiles 2023-11-10 10:54:48,339 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_ 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110e80a07453a434b6397c8a16b3d454c16 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/7b1bf464526c4beda7496f8c89dc2490 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110fdeaea1b5287438a894bd52405c423e4 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110fc802f49902f4ca1a7a5716d669ff086 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/f6de704529944b9cbe68c19a43978448] hfiles 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/f6de704529944b9cbe68c19a43978448 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/7f2fc503b1044524a84355b3863dbc49] hfiles 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/8ad63d4b1ab74bdebc7286bd99e252d6] hfiles 2023-11-10 10:54:48,340 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/7f2fc503b1044524a84355b3863dbc49 2023-11-10 10:54:48,341 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/8ad63d4b1ab74bdebc7286bd99e252d6 2023-11-10 10:54:48,350 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110007216f1c7334ac0ba6671a235c5b9d0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104805be3be4af403cb13cc0bdb87cf14c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104826ceab427a4741bad6c393ee18b56f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104c25582ca2d544b9ac64a210d60cc8b9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111038bf40fdaeee41ac8035f20ef699708d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110575d62b2c936494ca700c9560da12d79, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110aaed31b120f7445a9a7df44339bac6f4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110e2c2c8bcddde4f2d8ac07f089922c7cf, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311108084278498de411a81d9d968ca2eef09, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311109f6344623fb44519af80b05a212a0495, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110a3b24386ea9747ef8702bd84488de76d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110cc3a42f5aaee4f82b1fcbaa3d2586e98] hfiles 2023-11-10 10:54:48,350 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110007216f1c7334ac0ba6671a235c5b9d0 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104805be3be4af403cb13cc0bdb87cf14c 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104826ceab427a4741bad6c393ee18b56f 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311104c25582ca2d544b9ac64a210d60cc8b9 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023111038bf40fdaeee41ac8035f20ef699708d 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110575d62b2c936494ca700c9560da12d79 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110aaed31b120f7445a9a7df44339bac6f4 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231110e2c2c8bcddde4f2d8ac07f089922c7cf 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311108084278498de411a81d9d968ca2eef09 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311109f6344623fb44519af80b05a212a0495 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110a3b24386ea9747ef8702bd84488de76d 2023-11-10 10:54:48,351 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231110cc3a42f5aaee4f82b1fcbaa3d2586e98 2023-11-10 10:54:48,529 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:48,532 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-10 10:54:48,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-10 10:54:48,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:48,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:49,033 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:49,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:49,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-10 10:54:49,035 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-10 10:54:49,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699613675765-1699613687907 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:49,188 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699613675765-1699613687907 of table testCompactionWithHFileLink completed 2023-11-10 10:54:49,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:49,188 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:49,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699613675765-1699613687907 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699613687923Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699613688333 (+410 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699613675765-1699613687907 at 1699613688752 (+419 ms)Loading Region manifests for hbase-failsafe-snaptb-1699613675765-1699613687907 at 1699613688752Writing data manifest for hbase-failsafe-snaptb-1699613675765-1699613687907 at 1699613688760 (+8 ms)Verifying snapshot: hbase-failsafe-snaptb-1699613675765-1699613687907 at 1699613689169 (+409 ms)Snapshot hbase-failsafe-snaptb-1699613675765-1699613687907 of table testCompactionWithHFileLink completed at 1699613689188 (+19 ms) 2023-11-10 10:54:49,189 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-10 10:54:49,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2690 sec 2023-11-10 10:54:50,035 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-10 10:54:50,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-10 10:54:50,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699613675765-1699613687907 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-10 10:54:50,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699613675765" table: "testCompactionWithHFileLink" creation_time: 1699613675782 type: FLUSH version: 2 ttl: 0 ) 2023-11-10 10:54:50,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699613675765 as table=testCompactionWithHFileLink 2023-11-10 10:54:50,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-10 10:54:50,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-10 10:54:50,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-10 10:54:50,489 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:50,491 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:50,491 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-10 10:54:50,493 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-10 10:54:50,501 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699613675765" table: "testCompactionWithHFileLink" creation_time: 1699613675782 type: FLUSH version: 2 ttl: 0 2023-11-10 10:54:50,502 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink 2023-11-10 10:54:50,509 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-10 10:54:50,512 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110e80a07453a434b6397c8a16b3d454c16 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110e80a07453a434b6397c8a16b3d454c16 2023-11-10 10:54:50,513 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110fc802f49902f4ca1a7a5716d669ff086 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231110fc802f49902f4ca1a7a5716d669ff086 2023-11-10 10:54:50,515 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110fdeaea1b5287438a894bd52405c423e4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110fdeaea1b5287438a894bd52405c423e4 2023-11-10 10:54:50,515 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,518 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,522 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,526 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,530 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,533 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,536 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,538 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,541 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,543 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,546 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,548 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 of snapshot=snaptb-1699613675765 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-10 10:54:50,552 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231110b896b43b053e4195bfd46574c5b08579_del 2023-11-10 10:54:50,553 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023111004bb4122177642fca2d4bf39d759db60_del 2023-11-10 10:54:50,554 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311103d1882333e0347d5bbcaface45e33b29_del 2023-11-10 10:54:50,555 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:50,555 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:50,555 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:50,558 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/69f375b05df54cfeae1231725a9ec4c5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/69f375b05df54cfeae1231725a9ec4c5 2023-11-10 10:54:50,558 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/41fdeced1d8645eb9c44bde667ed9e2e_SeqId_29_ 2023-11-10 10:54:50,558 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/e1647f0395034882b191996a690a30a4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/e1647f0395034882b191996a690a30a4 2023-11-10 10:54:50,559 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/73e5dd04d9234bc2934049562817b3fb_SeqId_29_ 2023-11-10 10:54:50,559 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 120cd5a76d6549338bdda6c59e25ee1a of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,559 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/7b1bf464526c4beda7496f8c89dc2490 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/7b1bf464526c4beda7496f8c89dc2490 2023-11-10 10:54:50,559 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d374402cf74349cf810156e4ad3b0e32 of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,559 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/1ecc3dd8cc6c46b897b68c8ebde1f8cc_SeqId_29_ 2023-11-10 10:54:50,559 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5c8a6fe9b9354b00b8b2702c8d9e4071 of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,563 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 01913545fa6c42c2913b17dd672819f8 of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,563 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fdb0cefeab22442ea7113bb29654e1dd of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,563 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 48a5a00f694341f4a6fd65c96293a691 of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,567 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 87af7dc1fe6d434884be89675c455c07 of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,567 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d6d9a922b83d49b0b55fb83966d30c5d of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,568 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c181094e21d04306a6bcf095d2ef974a of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,570 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7017b3151306491d9d82f6dc040a4729 of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,570 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 21905665f15a4c21ba81a19f0b2c1d59 of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,570 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fd3c70ef74784b1b9c37020d3170bb24 of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,574 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/f6de704529944b9cbe68c19a43978448 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/f6de704529944b9cbe68c19a43978448 2023-11-10 10:54:50,574 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/8ad63d4b1ab74bdebc7286bd99e252d6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/8ad63d4b1ab74bdebc7286bd99e252d6 2023-11-10 10:54:50,574 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 36d606a02afb4aefb699061789e6c0a9 of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,574 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e172cff307714536bb0d686bd6e2b49b of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,576 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/7f2fc503b1044524a84355b3863dbc49 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/7f2fc503b1044524a84355b3863dbc49 2023-11-10 10:54:50,576 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cf252f9a20f9409788e2e320c889b7d1 of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,582 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 248519cd09784e60bc575658432088d4 of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,583 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0b42c39d227a42a8993104198718321b of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,584 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 202c85ba247e4282b5413aaa1a35d3ee of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,585 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cc6058e4246a4fad97e65932420e9d2b of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,586 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 459bc95291de45479cfcb92ffe9bc3a7 of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,587 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8940ff77d53c4858869dcef638637dab of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,588 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 01a5b542544f41608d6ed249bbcc68b8 of snapshot=snaptb-1699613675765 to region=d597a48975b7e6b8cc15edc5c51e69d0 table=testCompactionWithHFileLink 2023-11-10 10:54:50,588 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e9b15f9d5c4243f989ff563415100ef7 of snapshot=snaptb-1699613675765 to region=f39582ea31193f99288921c66f1414f1 table=testCompactionWithHFileLink 2023-11-10 10:54:50,590 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8fdc026c45f74af3b08bdd54611c8346 of snapshot=snaptb-1699613675765 to region=39aed9de2af4a055694f0d6732d82764 table=testCompactionWithHFileLink 2023-11-10 10:54:50,593 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699613675765" table: "testCompactionWithHFileLink" creation_time: 1699613675782 type: FLUSH version: 2 ttl: 0 2023-11-10 10:54:50,593 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699613690593"}]},"ts":"9223372036854775807"} 2023-11-10 10:54:50,594 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699613690593"}]},"ts":"9223372036854775807"} 2023-11-10 10:54:50,594 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699613690593"}]},"ts":"9223372036854775807"} 2023-11-10 10:54:50,595 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-10 10:54:50,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 39aed9de2af4a055694f0d6732d82764, NAME => 'testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => d597a48975b7e6b8cc15edc5c51e69d0, NAME => 'testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f39582ea31193f99288921c66f1414f1, NAME => 'testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-10 10:54:50,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613690594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613690594"}]},"ts":"1699613690594"} 2023-11-10 10:54:50,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613690594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613690594"}]},"ts":"1699613690594"} 2023-11-10 10:54:50,595 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613690594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613690594"}]},"ts":"1699613690594"} 2023-11-10 10:54:50,597 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-10 10:54:50,597 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-10 10:54:50,597 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 39aed9de2af4a055694f0d6732d82764, NAME => 'testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => d597a48975b7e6b8cc15edc5c51e69d0, NAME => 'testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f39582ea31193f99288921c66f1414f1, NAME => 'testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.', STARTKEY => '1', ENDKEY => '2'}] 2023-11-10 10:54:50,597 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699613675765 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-10 10:54:50,599 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699613675765" table: "testCompactionWithHFileLink" creation_time: 1699613675782 type: FLUSH version: 2 ttl: 0 ) in 529 msec 2023-11-10 10:54:50,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-10 10:54:50,686 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-10 10:54:50,686 INFO [Listener at localhost/37195] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:50,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1699613675765-1699613687907" 2023-11-10 10:54:50,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699613675765-1699613687907 2023-11-10 10:54:50,700 INFO [Listener at localhost/37195] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-10 10:54:50,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-11-10 10:54:50,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-10 10:54:50,716 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-10 10:54:50,716 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613690716"}]},"ts":"1699613690716"} 2023-11-10 10:54:50,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-10 10:54:50,717 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-10 10:54:50,719 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-10 10:54:50,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN}] 2023-11-10 10:54:50,721 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN 2023-11-10 10:54:50,721 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN 2023-11-10 10:54:50,721 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN 2023-11-10 10:54:50,721 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-10 10:54:50,722 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-10 10:54:50,722 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-10 10:54:50,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-10 10:54:50,873 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=f39582ea31193f99288921c66f1414f1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:50,873 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=d597a48975b7e6b8cc15edc5c51e69d0, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:50,873 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=39aed9de2af4a055694f0d6732d82764, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:50,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613690873"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613690873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613690873"}]},"ts":"1699613690873"} 2023-11-10 10:54:50,874 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613690873"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613690873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613690873"}]},"ts":"1699613690873"} 2023-11-10 10:54:50,874 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613690873"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613690873"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613690873"}]},"ts":"1699613690873"} 2023-11-10 10:54:50,876 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=98, state=RUNNABLE; OpenRegionProcedure d597a48975b7e6b8cc15edc5c51e69d0, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:50,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 39aed9de2af4a055694f0d6732d82764, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:50,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure f39582ea31193f99288921c66f1414f1, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:51,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-10 10:54:51,028 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:51,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:51,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 39aed9de2af4a055694f0d6732d82764, NAME => 'testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.', STARTKEY => '2', ENDKEY => ''} 2023-11-10 10:54:51,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:51,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,037 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,039 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:51,039 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:51,040 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39aed9de2af4a055694f0d6732d82764 columnFamilyName family1 2023-11-10 10:54:51,055 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-01913545fa6c42c2913b17dd672819f8 2023-11-10 10:54:51,062 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-5c8a6fe9b9354b00b8b2702c8d9e4071 2023-11-10 10:54:51,068 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-7017b3151306491d9d82f6dc040a4729 2023-11-10 10:54:51,072 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-87af7dc1fe6d434884be89675c455c07 2023-11-10 10:54:51,072 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(310): Store=39aed9de2af4a055694f0d6732d82764/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:51,072 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,073 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2 2023-11-10 10:54:51,073 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2 2023-11-10 10:54:51,073 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 39aed9de2af4a055694f0d6732d82764 columnFamilyName family2 2023-11-10 10:54:51,080 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-202c85ba247e4282b5413aaa1a35d3ee 2023-11-10 10:54:51,085 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8940ff77d53c4858869dcef638637dab 2023-11-10 10:54:51,092 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8fdc026c45f74af3b08bdd54611c8346 2023-11-10 10:54:51,100 DEBUG [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-cf252f9a20f9409788e2e320c889b7d1 2023-11-10 10:54:51,100 INFO [StoreOpener-39aed9de2af4a055694f0d6732d82764-1] regionserver.HStore(310): Store=39aed9de2af4a055694f0d6732d82764/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:51,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:51,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:54:51,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 39aed9de2af4a055694f0d6732d82764; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60170228, jitterRate=-0.10339373350143433}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:51,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:51,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764., pid=102, masterSystemTime=1699613691028 2023-11-10 10:54:51,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-10 10:54:51,105 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:54:51,105 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-10 10:54:51,105 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-10 10:54:51,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:51,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:51,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:51,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f39582ea31193f99288921c66f1414f1, NAME => 'testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.', STARTKEY => '1', ENDKEY => '2'} 2023-11-10 10:54:51,107 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=39aed9de2af4a055694f0d6732d82764, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:51,107 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613691107"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613691107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613691107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613691107"}]},"ts":"1699613691107"} 2023-11-10 10:54:51,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:51,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-10 10:54:51,108 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1912): 39aed9de2af4a055694f0d6732d82764/family1 is initiating minor compaction (all files) 2023-11-10 10:54:51,108 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-10 10:54:51,108 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 39aed9de2af4a055694f0d6732d82764/family1 in testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:51,108 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1912): 39aed9de2af4a055694f0d6732d82764/family2 is initiating minor compaction (all files) 2023-11-10 10:54:51,108 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-5c8a6fe9b9354b00b8b2702c8d9e4071, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-01913545fa6c42c2913b17dd672819f8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-87af7dc1fe6d434884be89675c455c07, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-7017b3151306491d9d82f6dc040a4729] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp, totalSize=21.6 K 2023-11-10 10:54:51,108 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 39aed9de2af4a055694f0d6732d82764/family2 in testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:54:51,108 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-cf252f9a20f9409788e2e320c889b7d1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-202c85ba247e4282b5413aaa1a35d3ee, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8940ff77d53c4858869dcef638637dab, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8fdc026c45f74af3b08bdd54611c8346] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp, totalSize=20.4 K 2023-11-10 10:54:51,108 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,109 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-5c8a6fe9b9354b00b8b2702c8d9e4071, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669308 2023-11-10 10:54:51,109 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-cf252f9a20f9409788e2e320c889b7d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669308 2023-11-10 10:54:51,109 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-01913545fa6c42c2913b17dd672819f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:51,109 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-202c85ba247e4282b5413aaa1a35d3ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:51,109 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:51,110 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:51,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-11-10 10:54:51,110 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-87af7dc1fe6d434884be89675c455c07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:51,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 39aed9de2af4a055694f0d6732d82764, server=jenkins-hbase20.apache.org,43721,1699613570510 in 232 msec 2023-11-10 10:54:51,110 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f39582ea31193f99288921c66f1414f1 columnFamilyName family1 2023-11-10 10:54:51,110 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8940ff77d53c4858869dcef638637dab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:51,111 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-7017b3151306491d9d82f6dc040a4729, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:51,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=39aed9de2af4a055694f0d6732d82764, ASSIGN in 391 msec 2023-11-10 10:54:51,111 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8fdc026c45f74af3b08bdd54611c8346, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:51,123 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-48a5a00f694341f4a6fd65c96293a691 2023-11-10 10:54:51,131 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-c181094e21d04306a6bcf095d2ef974a 2023-11-10 10:54:51,138 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] throttle.PressureAwareThroughputController(145): 39aed9de2af4a055694f0d6732d82764#family2#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:51,138 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): 39aed9de2af4a055694f0d6732d82764#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:51,138 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-d374402cf74349cf810156e4ad3b0e32 2023-11-10 10:54:51,144 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-fd3c70ef74784b1b9c37020d3170bb24 2023-11-10 10:54:51,144 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(310): Store=f39582ea31193f99288921c66f1414f1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:51,145 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,145 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2 2023-11-10 10:54:51,145 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2 2023-11-10 10:54:51,146 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f39582ea31193f99288921c66f1414f1 columnFamilyName family2 2023-11-10 10:54:51,152 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-0b42c39d227a42a8993104198718321b 2023-11-10 10:54:51,157 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-459bc95291de45479cfcb92ffe9bc3a7 2023-11-10 10:54:51,163 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e172cff307714536bb0d686bd6e2b49b 2023-11-10 10:54:51,170 DEBUG [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e9b15f9d5c4243f989ff563415100ef7 2023-11-10 10:54:51,170 INFO [StoreOpener-f39582ea31193f99288921c66f1414f1-1] regionserver.HStore(310): Store=f39582ea31193f99288921c66f1414f1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:51,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:51,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f39582ea31193f99288921c66f1414f1 2023-11-10 10:54:51,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f39582ea31193f99288921c66f1414f1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72800344, jitterRate=0.08480966091156006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:51,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:51,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1., pid=103, masterSystemTime=1699613691028 2023-11-10 10:54:51,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-10 10:54:51,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-10 10:54:51,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:51,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:51,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:51,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d597a48975b7e6b8cc15edc5c51e69d0, NAME => 'testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.', STARTKEY => '', ENDKEY => '1'} 2023-11-10 10:54:51,181 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=f39582ea31193f99288921c66f1414f1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:51,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:51,182 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613691181"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613691181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613691181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613691181"}]},"ts":"1699613691181"} 2023-11-10 10:54:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,183 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,185 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:51,185 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:51,185 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d597a48975b7e6b8cc15edc5c51e69d0 columnFamilyName family1 2023-11-10 10:54:51,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-11-10 10:54:51,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure f39582ea31193f99288921c66f1414f1, server=jenkins-hbase20.apache.org,43721,1699613570510 in 306 msec 2023-11-10 10:54:51,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=f39582ea31193f99288921c66f1414f1, ASSIGN in 467 msec 2023-11-10 10:54:51,193 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-120cd5a76d6549338bdda6c59e25ee1a 2023-11-10 10:54:51,197 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-21905665f15a4c21ba81a19f0b2c1d59 2023-11-10 10:54:51,203 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-d6d9a922b83d49b0b55fb83966d30c5d 2023-11-10 10:54:51,209 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-fdb0cefeab22442ea7113bb29654e1dd 2023-11-10 10:54:51,210 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(310): Store=d597a48975b7e6b8cc15edc5c51e69d0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:51,210 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,211 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2 2023-11-10 10:54:51,211 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2 2023-11-10 10:54:51,211 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d597a48975b7e6b8cc15edc5c51e69d0 columnFamilyName family2 2023-11-10 10:54:51,221 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-01a5b542544f41608d6ed249bbcc68b8 2023-11-10 10:54:51,231 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-248519cd09784e60bc575658432088d4 2023-11-10 10:54:51,240 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-36d606a02afb4aefb699061789e6c0a9 2023-11-10 10:54:51,250 DEBUG [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(539): loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-cc6058e4246a4fad97e65932420e9d2b 2023-11-10 10:54:51,250 INFO [StoreOpener-d597a48975b7e6b8cc15edc5c51e69d0-1] regionserver.HStore(310): Store=d597a48975b7e6b8cc15edc5c51e69d0/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:51,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:51,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:54:51,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d597a48975b7e6b8cc15edc5c51e69d0; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68298442, jitterRate=0.017726093530654907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:51,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:51,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0., pid=101, masterSystemTime=1699613691028 2023-11-10 10:54:51,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-10 10:54:51,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-10 10:54:51,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:51,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:51,259 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=d597a48975b7e6b8cc15edc5c51e69d0, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:51,259 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699613691259"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613691259"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613691259"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613691259"}]},"ts":"1699613691259"} 2023-11-10 10:54:51,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=98 2023-11-10 10:54:51,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=98, state=SUCCESS; OpenRegionProcedure d597a48975b7e6b8cc15edc5c51e69d0, server=jenkins-hbase20.apache.org,43721,1699613570510 in 384 msec 2023-11-10 10:54:51,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-11-10 10:54:51,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d597a48975b7e6b8cc15edc5c51e69d0, ASSIGN in 542 msec 2023-11-10 10:54:51,263 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613691263"}]},"ts":"1699613691263"} 2023-11-10 10:54:51,264 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-10 10:54:51,265 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-10 10:54:51,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 558 msec 2023-11-10 10:54:51,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-10 10:54:51,323 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-10 10:54:51,343 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:51,352 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:51,361 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:51,362 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:51,368 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-10 10:54:51,379 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-10 10:54:51,380 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,380 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(139): Connect 0x2f26fa6d to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:54:51,384 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cb0a1ed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:54:51,384 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:51,384 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:51,384 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:51,860 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110c8276cf0e35a4a6697557a269497a097 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231110c8276cf0e35a4a6697557a269497a097 2023-11-10 10:54:51,860 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110e667d64a040c428da3fa99b1f0e86b4f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231110e667d64a040c428da3fa99b1f0e86b4f 2023-11-10 10:54:51,861 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311107bfb3be7f89e4f15a7d1de40062eeae3 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311107bfb3be7f89e4f15a7d1de40062eeae3 2023-11-10 10:54:51,861 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,861 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,861 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,873 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:54:51,876 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:54:51,882 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:54:51,889 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:54:51,912 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/401910b683674cb097892a8809170fbf first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-10 10:54:51,920 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/401910b683674cb097892a8809170fbf}] 2023-11-10 10:54:51,925 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/401910b683674cb097892a8809170fbf for inclusion in 39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:51,925 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/f839e985c0644609a42ddf91d98e88bd first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-10 10:54:51,926 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/83d710e46daa479bb2277b0da167a8d1 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-10 10:54:51,926 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/f839e985c0644609a42ddf91d98e88bd}] 2023-11-10 10:54:51,927 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=32 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/83d710e46daa479bb2277b0da167a8d1}] 2023-11-10 10:54:51,929 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/f839e985c0644609a42ddf91d98e88bd for inclusion in f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:51,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-10 10:54:51,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/83d710e46daa479bb2277b0da167a8d1 for inclusion in d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:51,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-10 10:54:51,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:51,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110/family1/401910b683674cb097892a8809170fbf to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__74ddq7hlgg20ge5v5fpf28o9jpkcr6oefs4rc4u87du6nccgidd511iohju6iki1/family1/401910b683674cb097892a8809170fbf 2023-11-10 10:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-10 10:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last=1 2023-11-10 10:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-10 10:54:51,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-10 10:54:51,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__74ddq7hlgg20ge5v5fpf28o9jpkcr6oefs4rc4u87du6nccgidd511iohju6iki1/family1/401910b683674cb097892a8809170fbf as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/878b90a10b2f41b9b950dec5618b2a38_SeqId_34_ 2023-11-10 10:54:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110/family1/f839e985c0644609a42ddf91d98e88bd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__72lj9asqumen73ca8s9s1lkemqmgkrm1lngqgf0t7i6nhae5j2b50sp602rm29bs/family1/f839e985c0644609a42ddf91d98e88bd 2023-11-10 10:54:51,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110/family1/83d710e46daa479bb2277b0da167a8d1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__k3o04u3spjco4strgg5tia48b3d8lt1sevsd1cpovgecreip77m38bor5th28tng/family1/83d710e46daa479bb2277b0da167a8d1 2023-11-10 10:54:51,934 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__74ddq7hlgg20ge5v5fpf28o9jpkcr6oefs4rc4u87du6nccgidd511iohju6iki1/family1/401910b683674cb097892a8809170fbf into 39aed9de2af4a055694f0d6732d82764/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/878b90a10b2f41b9b950dec5618b2a38_SeqId_34_ - updating store file list. 2023-11-10 10:54:51,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__72lj9asqumen73ca8s9s1lkemqmgkrm1lngqgf0t7i6nhae5j2b50sp602rm29bs/family1/f839e985c0644609a42ddf91d98e88bd as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_ 2023-11-10 10:54:51,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__k3o04u3spjco4strgg5tia48b3d8lt1sevsd1cpovgecreip77m38bor5th28tng/family1/83d710e46daa479bb2277b0da167a8d1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_ 2023-11-10 10:54:51,936 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__72lj9asqumen73ca8s9s1lkemqmgkrm1lngqgf0t7i6nhae5j2b50sp602rm29bs/family1/f839e985c0644609a42ddf91d98e88bd into f39582ea31193f99288921c66f1414f1/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_ - updating store file list. 2023-11-10 10:54:51,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__k3o04u3spjco4strgg5tia48b3d8lt1sevsd1cpovgecreip77m38bor5th28tng/family1/83d710e46daa479bb2277b0da167a8d1 into d597a48975b7e6b8cc15edc5c51e69d0/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_ - updating store file list. 2023-11-10 10:54:51,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/878b90a10b2f41b9b950dec5618b2a38_SeqId_34_ into 39aed9de2af4a055694f0d6732d82764/family1 2023-11-10 10:54:51,937 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__74ddq7hlgg20ge5v5fpf28o9jpkcr6oefs4rc4u87du6nccgidd511iohju6iki1/family1/401910b683674cb097892a8809170fbf into 39aed9de2af4a055694f0d6732d82764/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/878b90a10b2f41b9b950dec5618b2a38_SeqId_34_) 2023-11-10 10:54:51,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__74ddq7hlgg20ge5v5fpf28o9jpkcr6oefs4rc4u87du6nccgidd511iohju6iki1/family1/401910b683674cb097892a8809170fbf 2023-11-10 10:54:51,939 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,940 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:51,941 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231110735da25c10b045d7abc0eee1d5e55c7c 2023-11-10 10:54:51,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_ into d597a48975b7e6b8cc15edc5c51e69d0/family1 2023-11-10 10:54:51,942 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_ into f39582ea31193f99288921c66f1414f1/family1 2023-11-10 10:54:51,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__k3o04u3spjco4strgg5tia48b3d8lt1sevsd1cpovgecreip77m38bor5th28tng/family1/83d710e46daa479bb2277b0da167a8d1 into d597a48975b7e6b8cc15edc5c51e69d0/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_) 2023-11-10 10:54:51,942 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__72lj9asqumen73ca8s9s1lkemqmgkrm1lngqgf0t7i6nhae5j2b50sp602rm29bs/family1/f839e985c0644609a42ddf91d98e88bd into f39582ea31193f99288921c66f1414f1/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_) 2023-11-10 10:54:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__k3o04u3spjco4strgg5tia48b3d8lt1sevsd1cpovgecreip77m38bor5th28tng/family1/83d710e46daa479bb2277b0da167a8d1 2023-11-10 10:54:51,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testCompactionWithHFileLink__72lj9asqumen73ca8s9s1lkemqmgkrm1lngqgf0t7i6nhae5j2b50sp602rm29bs/family1/f839e985c0644609a42ddf91d98e88bd 2023-11-10 10:54:51,943 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023111074a2de9c471c4d69a3e6babbefed5e7f 2023-11-10 10:54:51,944 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311107d76affcb3d34b6c862ad6153e66976b 2023-11-10 10:54:51,945 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231110ebb63963ba244138baf8b113bad76bc9 2023-11-10 10:54:51,945 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-10 10:54:51,945 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231110' 2023-11-10 10:54:51,946 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:51,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-10 10:54:51,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): d597a48975b7e6b8cc15edc5c51e69d0/family1 is initiating minor compaction (all files) 2023-11-10 10:54:51,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6fd69ba7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-10 10:54:51,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:54:51,948 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,948 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:51,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-10 10:54:51,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(1912): f39582ea31193f99288921c66f1414f1/family1 is initiating minor compaction (all files) 2023-11-10 10:54:51,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@68052e81; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-10 10:54:51,949 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311105d690b78a35346fbbc9eb386900d9509 2023-11-10 10:54:51,950 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,951 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311106170df56c0134e40b85c1e28f72b7728 2023-11-10 10:54:51,951 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:51,953 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231110adf45311985a4f7f844e0b9427c54ec7 2023-11-10 10:54:51,954 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023111041843905594042b589bda003823d16b0 2023-11-10 10:54:51,954 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231110f6e998212d8043928becf7a0b238b695 2023-11-10 10:54:51,954 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-10 10:54:51,955 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231110' 2023-11-10 10:54:51,955 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:51,955 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311104bc927f90a85408ca820bb941c6a51ea 2023-11-10 10:54:51,956 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231110f5179495b74d4a0281806e31fb6e043f 2023-11-10 10:54:51,957 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231110fc5693da31724268869f78d7172be0fb 2023-11-10 10:54:51,957 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-10 10:54:51,957 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231110' 2023-11-10 10:54:51,957 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231110 for table='testCompactionWithHFileLink' and column='family1' 2023-11-10 10:54:51,958 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-10 10:54:51,960 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:51,963 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:51,967 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:51,968 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:51,972 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family1/e823c64c29174608b3c7bc0b6439f29c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/e823c64c29174608b3c7bc0b6439f29c 2023-11-10 10:54:51,976 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:54:51,977 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/.tmp/family2/ed59933a6c5641908f4e1e7a83f3e811 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/ed59933a6c5641908f4e1e7a83f3e811 2023-11-10 10:54:51,978 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:54:51,978 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 39aed9de2af4a055694f0d6732d82764/family1 of 39aed9de2af4a055694f0d6732d82764 into e823c64c29174608b3c7bc0b6439f29c(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:54:51,978 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:51,978 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764., storeName=39aed9de2af4a055694f0d6732d82764/family1, priority=12, startTime=1699613691105; duration=0sec 2023-11-10 10:54:51,978 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-10 10:54:51,978 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of d597a48975b7e6b8cc15edc5c51e69d0/family1 in testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:51,978 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-120cd5a76d6549338bdda6c59e25ee1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-fdb0cefeab22442ea7113bb29654e1dd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-d6d9a922b83d49b0b55fb83966d30c5d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-21905665f15a4c21ba81a19f0b2c1d59, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp, totalSize=28.9 K 2023-11-10 10:54:51,980 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-120cd5a76d6549338bdda6c59e25ee1a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669306 2023-11-10 10:54:51,981 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-fdb0cefeab22442ea7113bb29654e1dd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670694 2023-11-10 10:54:51,986 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-d6d9a922b83d49b0b55fb83966d30c5d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:51,987 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-21905665f15a4c21ba81a19f0b2c1d59, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674353 2023-11-10 10:54:51,988 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting 9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699613669306 2023-11-10 10:54:51,992 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 39aed9de2af4a055694f0d6732d82764/family2 of 39aed9de2af4a055694f0d6732d82764 into ed59933a6c5641908f4e1e7a83f3e811(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:54:51,992 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:54:51,992 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764., storeName=39aed9de2af4a055694f0d6732d82764/family2, priority=12, startTime=1699613691105; duration=0sec 2023-11-10 10:54:51,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-5c8a6fe9b9354b00b8b2702c8d9e4071, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-01913545fa6c42c2913b17dd672819f8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-87af7dc1fe6d434884be89675c455c07, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-7017b3151306491d9d82f6dc040a4729] to archive 2023-11-10 10:54:51,992 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-10 10:54:51,993 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of f39582ea31193f99288921c66f1414f1/family1 in testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:51,993 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-d374402cf74349cf810156e4ad3b0e32, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-48a5a00f694341f4a6fd65c96293a691, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-c181094e21d04306a6bcf095d2ef974a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-fd3c70ef74784b1b9c37020d3170bb24, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp, totalSize=28.9 K 2023-11-10 10:54:51,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:51,994 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-d374402cf74349cf810156e4ad3b0e32, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669307 2023-11-10 10:54:51,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-5c8a6fe9b9354b00b8b2702c8d9e4071 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-5c8a6fe9b9354b00b8b2702c8d9e4071 2023-11-10 10:54:51,995 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-48a5a00f694341f4a6fd65c96293a691, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:51,996 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-c181094e21d04306a6bcf095d2ef974a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:51,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-01913545fa6c42c2913b17dd672819f8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-01913545fa6c42c2913b17dd672819f8 2023-11-10 10:54:51,997 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-fd3c70ef74784b1b9c37020d3170bb24, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:51,997 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting 8e273feeb9644fd59ef93c47191d6f02_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699613669307 2023-11-10 10:54:51,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-87af7dc1fe6d434884be89675c455c07 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-87af7dc1fe6d434884be89675c455c07 2023-11-10 10:54:52,001 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=293 (was 242) - Thread LEAK? -, OpenFileDescriptor=809 (was 626) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=121 (was 165), ProcessCount=166 (was 166), AvailableMemoryMB=8334 (was 8360) 2023-11-10 10:54:52,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-7017b3151306491d9d82f6dc040a4729 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family1/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-7017b3151306491d9d82f6dc040a4729 2023-11-10 10:54:52,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-cf252f9a20f9409788e2e320c889b7d1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-202c85ba247e4282b5413aaa1a35d3ee, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8940ff77d53c4858869dcef638637dab, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8fdc026c45f74af3b08bdd54611c8346] to archive 2023-11-10 10:54:52,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:52,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-cf252f9a20f9409788e2e320c889b7d1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-cf252f9a20f9409788e2e320c889b7d1 2023-11-10 10:54:52,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-202c85ba247e4282b5413aaa1a35d3ee to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-202c85ba247e4282b5413aaa1a35d3ee 2023-11-10 10:54:52,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8940ff77d53c4858869dcef638637dab to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8940ff77d53c4858869dcef638637dab 2023-11-10 10:54:52,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8fdc026c45f74af3b08bdd54611c8346 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/family2/testCompactionWithHFileLink=39aed9de2af4a055694f0d6732d82764-8fdc026c45f74af3b08bdd54611c8346 2023-11-10 10:54:52,016 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=291, OpenFileDescriptor=797, MaxFileDescriptor=60000, SystemLoadAverage=121, ProcessCount=166, AvailableMemoryMB=8333 2023-11-10 10:54:52,022 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-11-10 10:54:52,023 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): d597a48975b7e6b8cc15edc5c51e69d0#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:52,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-10 10:54:52,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-10 10:54:52,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-10 10:54:52,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 11 msec 2023-11-10 10:54:52,043 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] throttle.PressureAwareThroughputController(145): f39582ea31193f99288921c66f1414f1#family1#compaction#117 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:54:52,081 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-10 10:54:52,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-10 10:54:52,133 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-10 10:54:52,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-10 10:54:52,136 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:54:52,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-10 10:54:52,137 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:54:52,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-10 10:54:52,138 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:52,138 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:52,138 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:52,139 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff empty. 2023-11-10 10:54:52,139 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b empty. 2023-11-10 10:54:52,139 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65 empty. 2023-11-10 10:54:52,139 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:52,139 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:52,139 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:52,139 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-10 10:54:52,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-10 10:54:52,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-10 10:54:52,546 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-10 10:54:52,546 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => aec7f5328d591ab91ad7d6c0448f66ff, NAME => 'ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:52,547 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0cd96916b2d2e727befbf8dce6a73b3b, NAME => 'ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:52,547 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3df0b49e0178a4ede9f722a9850f8b65, NAME => 'ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:54:52,552 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:52,552 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 3df0b49e0178a4ede9f722a9850f8b65, disabling compactions & flushes 2023-11-10 10:54:52,552 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:52,552 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:52,552 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. after waiting 0 ms 2023-11-10 10:54:52,552 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:52,552 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:52,552 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:54:52,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-10 10:54:52,954 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:52,954 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:52,954 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing aec7f5328d591ab91ad7d6c0448f66ff, disabling compactions & flushes 2023-11-10 10:54:52,954 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 0cd96916b2d2e727befbf8dce6a73b3b, disabling compactions & flushes 2023-11-10 10:54:52,954 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:52,955 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:52,955 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:52,955 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:52,955 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. after waiting 0 ms 2023-11-10 10:54:52,955 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. after waiting 0 ms 2023-11-10 10:54:52,955 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:52,956 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:52,956 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:52,956 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:52,956 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:54:52,956 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:54:52,962 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:54:52,964 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699613692964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613692964"}]},"ts":"1699613692964"} 2023-11-10 10:54:52,964 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699613692964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613692964"}]},"ts":"1699613692964"} 2023-11-10 10:54:52,964 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699613692964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613692964"}]},"ts":"1699613692964"} 2023-11-10 10:54:52,967 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-10 10:54:52,968 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:54:52,968 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613692968"}]},"ts":"1699613692968"} 2023-11-10 10:54:52,969 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-10 10:54:52,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aec7f5328d591ab91ad7d6c0448f66ff, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3df0b49e0178a4ede9f722a9850f8b65, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0cd96916b2d2e727befbf8dce6a73b3b, ASSIGN}] 2023-11-10 10:54:52,975 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3df0b49e0178a4ede9f722a9850f8b65, ASSIGN 2023-11-10 10:54:52,975 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aec7f5328d591ab91ad7d6c0448f66ff, ASSIGN 2023-11-10 10:54:52,975 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0cd96916b2d2e727befbf8dce6a73b3b, ASSIGN 2023-11-10 10:54:52,976 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0cd96916b2d2e727befbf8dce6a73b3b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:52,976 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aec7f5328d591ab91ad7d6c0448f66ff, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:52,976 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3df0b49e0178a4ede9f722a9850f8b65, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:54:53,131 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=aec7f5328d591ab91ad7d6c0448f66ff, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,131 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3df0b49e0178a4ede9f722a9850f8b65, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,131 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=0cd96916b2d2e727befbf8dce6a73b3b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,131 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699613693131"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613693131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613693131"}]},"ts":"1699613693131"} 2023-11-10 10:54:53,131 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699613693131"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613693131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613693131"}]},"ts":"1699613693131"} 2023-11-10 10:54:53,131 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699613693131"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613693131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613693131"}]},"ts":"1699613693131"} 2023-11-10 10:54:53,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure aec7f5328d591ab91ad7d6c0448f66ff, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:53,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 0cd96916b2d2e727befbf8dce6a73b3b, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:53,134 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 3df0b49e0178a4ede9f722a9850f8b65, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:54:53,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-10 10:54:53,263 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family1/0721d0d407da4a7284d1dd68c98da456 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/0721d0d407da4a7284d1dd68c98da456 2023-11-10 10:54:53,263 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family1/4f98fb2cf5474c61a5d6618ba3d68167 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/4f98fb2cf5474c61a5d6618ba3d68167 2023-11-10 10:54:53,267 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in d597a48975b7e6b8cc15edc5c51e69d0/family1 of d597a48975b7e6b8cc15edc5c51e69d0 into 4f98fb2cf5474c61a5d6618ba3d68167(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:53,267 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in f39582ea31193f99288921c66f1414f1/family1 of f39582ea31193f99288921c66f1414f1 into 0721d0d407da4a7284d1dd68c98da456(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:53,267 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:53,267 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:53,267 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699613691946; duration=1sec 2023-11-10 10:54:53,268 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699613691948; duration=1sec 2023-11-10 10:54:53,268 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-10 10:54:53,268 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-10 10:54:53,268 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-10 10:54:53,268 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-10 10:54:53,270 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-10 10:54:53,270 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-10 10:54:53,270 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1912): f39582ea31193f99288921c66f1414f1/family2 is initiating minor compaction (all files) 2023-11-10 10:54:53,270 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1912): d597a48975b7e6b8cc15edc5c51e69d0/family2 is initiating minor compaction (all files) 2023-11-10 10:54:53,270 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f39582ea31193f99288921c66f1414f1/family2 in testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:54:53,270 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of d597a48975b7e6b8cc15edc5c51e69d0/family2 in testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:54:53,270 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e172cff307714536bb0d686bd6e2b49b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-0b42c39d227a42a8993104198718321b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-459bc95291de45479cfcb92ffe9bc3a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e9b15f9d5c4243f989ff563415100ef7] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp, totalSize=20.4 K 2023-11-10 10:54:53,270 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-36d606a02afb4aefb699061789e6c0a9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-248519cd09784e60bc575658432088d4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-cc6058e4246a4fad97e65932420e9d2b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-01a5b542544f41608d6ed249bbcc68b8] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp, totalSize=20.4 K 2023-11-10 10:54:53,270 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e172cff307714536bb0d686bd6e2b49b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669307 2023-11-10 10:54:53,271 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-36d606a02afb4aefb699061789e6c0a9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613669306 2023-11-10 10:54:53,271 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-0b42c39d227a42a8993104198718321b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670695 2023-11-10 10:54:53,271 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-248519cd09784e60bc575658432088d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613670694 2023-11-10 10:54:53,271 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-459bc95291de45479cfcb92ffe9bc3a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:53,272 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-cc6058e4246a4fad97e65932420e9d2b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613672523 2023-11-10 10:54:53,272 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e9b15f9d5c4243f989ff563415100ef7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674354 2023-11-10 10:54:53,272 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-01a5b542544f41608d6ed249bbcc68b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613674353 2023-11-10 10:54:53,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-d374402cf74349cf810156e4ad3b0e32, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-48a5a00f694341f4a6fd65c96293a691, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-c181094e21d04306a6bcf095d2ef974a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-fd3c70ef74784b1b9c37020d3170bb24, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_] to archive 2023-11-10 10:54:53,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:53,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-d374402cf74349cf810156e4ad3b0e32 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-d374402cf74349cf810156e4ad3b0e32 2023-11-10 10:54:53,284 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-48a5a00f694341f4a6fd65c96293a691 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-48a5a00f694341f4a6fd65c96293a691 2023-11-10 10:54:53,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:53,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3df0b49e0178a4ede9f722a9850f8b65, NAME => 'ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.', STARTKEY => '1', ENDKEY => '2'} 2023-11-10 10:54:53,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:53,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-c181094e21d04306a6bcf095d2ef974a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-c181094e21d04306a6bcf095d2ef974a 2023-11-10 10:54:53,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-fd3c70ef74784b1b9c37020d3170bb24 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-fd3c70ef74784b1b9c37020d3170bb24 2023-11-10 10:54:53,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family1/8e273feeb9644fd59ef93c47191d6f02_SeqId_34_ 2023-11-10 10:54:53,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-120cd5a76d6549338bdda6c59e25ee1a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-fdb0cefeab22442ea7113bb29654e1dd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-d6d9a922b83d49b0b55fb83966d30c5d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-21905665f15a4c21ba81a19f0b2c1d59, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_] to archive 2023-11-10 10:54:53,291 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] throttle.PressureAwareThroughputController(145): d597a48975b7e6b8cc15edc5c51e69d0#family2#compaction#118 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-11-10 10:54:53,291 INFO [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,291 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): f39582ea31193f99288921c66f1414f1#family2#compaction#119 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-10 10:54:53,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:53,292 DEBUG [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1 2023-11-10 10:54:53,292 DEBUG [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1 2023-11-10 10:54:53,293 INFO [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3df0b49e0178a4ede9f722a9850f8b65 columnFamilyName family1 2023-11-10 10:54:53,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-120cd5a76d6549338bdda6c59e25ee1a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-120cd5a76d6549338bdda6c59e25ee1a 2023-11-10 10:54:53,294 INFO [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] regionserver.HStore(310): Store=3df0b49e0178a4ede9f722a9850f8b65/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:53,294 INFO [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-fdb0cefeab22442ea7113bb29654e1dd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-fdb0cefeab22442ea7113bb29654e1dd 2023-11-10 10:54:53,295 DEBUG [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2 2023-11-10 10:54:53,295 DEBUG [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2 2023-11-10 10:54:53,296 INFO [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3df0b49e0178a4ede9f722a9850f8b65 columnFamilyName family2 2023-11-10 10:54:53,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-d6d9a922b83d49b0b55fb83966d30c5d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-d6d9a922b83d49b0b55fb83966d30c5d 2023-11-10 10:54:53,297 INFO [StoreOpener-3df0b49e0178a4ede9f722a9850f8b65-1] regionserver.HStore(310): Store=3df0b49e0178a4ede9f722a9850f8b65/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:53,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-21905665f15a4c21ba81a19f0b2c1d59 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-21905665f15a4c21ba81a19f0b2c1d59 2023-11-10 10:54:53,297 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family1/9ca6ae4368fd4a26b99b523e1e13f8f4_SeqId_34_ 2023-11-10 10:54:53,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:53,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:54:53,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:53,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3df0b49e0178a4ede9f722a9850f8b65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66429952, jitterRate=-0.0101165771484375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:53,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:54:53,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65., pid=111, masterSystemTime=1699613693284 2023-11-10 10:54:53,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:53,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:53,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:53,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aec7f5328d591ab91ad7d6c0448f66ff, NAME => 'ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.', STARTKEY => '', ENDKEY => '1'} 2023-11-10 10:54:53,303 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3df0b49e0178a4ede9f722a9850f8b65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,303 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699613693303"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613693303"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613693303"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613693303"}]},"ts":"1699613693303"} 2023-11-10 10:54:53,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:53,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,304 INFO [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,305 DEBUG [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1 2023-11-10 10:54:53,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=107 2023-11-10 10:54:53,305 DEBUG [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1 2023-11-10 10:54:53,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 3df0b49e0178a4ede9f722a9850f8b65, server=jenkins-hbase20.apache.org,43721,1699613570510 in 170 msec 2023-11-10 10:54:53,306 INFO [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aec7f5328d591ab91ad7d6c0448f66ff columnFamilyName family1 2023-11-10 10:54:53,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3df0b49e0178a4ede9f722a9850f8b65, ASSIGN in 332 msec 2023-11-10 10:54:53,306 INFO [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] regionserver.HStore(310): Store=aec7f5328d591ab91ad7d6c0448f66ff/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:53,307 INFO [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,307 DEBUG [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2 2023-11-10 10:54:53,307 DEBUG [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2 2023-11-10 10:54:53,308 INFO [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aec7f5328d591ab91ad7d6c0448f66ff columnFamilyName family2 2023-11-10 10:54:53,308 INFO [StoreOpener-aec7f5328d591ab91ad7d6c0448f66ff-1] regionserver.HStore(310): Store=aec7f5328d591ab91ad7d6c0448f66ff/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:53,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,310 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:54:53,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:53,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:54:53,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:53,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aec7f5328d591ab91ad7d6c0448f66ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72399873, jitterRate=0.0788421779870987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:53,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:54:53,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff., pid=109, masterSystemTime=1699613693284 2023-11-10 10:54:53,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:53,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:53,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:53,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cd96916b2d2e727befbf8dce6a73b3b, NAME => 'ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.', STARTKEY => '2', ENDKEY => ''} 2023-11-10 10:54:53,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=aec7f5328d591ab91ad7d6c0448f66ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699613693316"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613693316"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613693316"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613693316"}]},"ts":"1699613693316"} 2023-11-10 10:54:53,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:54:53,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,318 INFO [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-11-10 10:54:53,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure aec7f5328d591ab91ad7d6c0448f66ff, server=jenkins-hbase20.apache.org,43721,1699613570510 in 184 msec 2023-11-10 10:54:53,320 DEBUG [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1 2023-11-10 10:54:53,320 DEBUG [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1 2023-11-10 10:54:53,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=aec7f5328d591ab91ad7d6c0448f66ff, ASSIGN in 346 msec 2023-11-10 10:54:53,320 INFO [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cd96916b2d2e727befbf8dce6a73b3b columnFamilyName family1 2023-11-10 10:54:53,321 INFO [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] regionserver.HStore(310): Store=0cd96916b2d2e727befbf8dce6a73b3b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:53,321 INFO [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,322 DEBUG [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2 2023-11-10 10:54:53,322 DEBUG [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2 2023-11-10 10:54:53,323 INFO [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cd96916b2d2e727befbf8dce6a73b3b columnFamilyName family2 2023-11-10 10:54:53,323 INFO [StoreOpener-0cd96916b2d2e727befbf8dce6a73b3b-1] regionserver.HStore(310): Store=0cd96916b2d2e727befbf8dce6a73b3b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:54:53,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:54:53,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:54:53,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:54:53,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0cd96916b2d2e727befbf8dce6a73b3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59945338, jitterRate=-0.10674485564231873}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:54:53,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:54:53,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b., pid=110, masterSystemTime=1699613693284 2023-11-10 10:54:53,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:53,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:53,330 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=0cd96916b2d2e727befbf8dce6a73b3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:53,330 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699613693330"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613693330"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613693330"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613693330"}]},"ts":"1699613693330"} 2023-11-10 10:54:53,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-11-10 10:54:53,333 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 0cd96916b2d2e727befbf8dce6a73b3b, server=jenkins-hbase20.apache.org,43721,1699613570510 in 199 msec 2023-11-10 10:54:53,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-11-10 10:54:53,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=0cd96916b2d2e727befbf8dce6a73b3b, ASSIGN in 360 msec 2023-11-10 10:54:53,335 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:54:53,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613693335"}]},"ts":"1699613693335"} 2023-11-10 10:54:53,336 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-10 10:54:53,351 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:53,351 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:54:53,351 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f26fa6d to 127.0.0.1:62972 2023-11-10 10:54:53,351 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:53,351 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56a620f6 to 127.0.0.1:62972 2023-11-10 10:54:53,351 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:53,351 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:53,351 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f7dbdfb to 127.0.0.1:62972 2023-11-10 10:54:53,351 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:53,359 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:54:53,360 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ed93a2 to 127.0.0.1:62972 2023-11-10 10:54:53,360 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:54:53,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2170 sec 2023-11-10 10:54:54,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-10 10:54:54,249 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-10 10:54:54,260 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:54,261 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:54,261 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:54,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:54,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-10 10:54:54,264 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-10 10:54:54,264 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:54,264 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-10 10:54:54,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-10 10:54:54,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:54,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:54,266 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:54,266 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:54,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:54,266 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:54,267 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:54,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:54,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-10 10:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-10 10:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-10 10:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-10 10:54:54,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:54,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. started... 2023-11-10 10:54:54,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:54,270 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:54,270 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:54,270 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. started... 2023-11-10 10:54:54,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. started... 2023-11-10 10:54:54,270 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aec7f5328d591ab91ad7d6c0448f66ff 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:54:54,270 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3df0b49e0178a4ede9f722a9850f8b65 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:54:54,270 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0cd96916b2d2e727befbf8dce6a73b3b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:54:54,523 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/.tmp/family2/71bd4473d5bc428ba9c2ee49530d3df0 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/71bd4473d5bc428ba9c2ee49530d3df0 2023-11-10 10:54:54,523 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/.tmp/family2/5032ec3824c14c2198980132e13356fb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/5032ec3824c14c2198980132e13356fb 2023-11-10 10:54:54,530 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in f39582ea31193f99288921c66f1414f1/family2 of f39582ea31193f99288921c66f1414f1 into 5032ec3824c14c2198980132e13356fb(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:54,530 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d597a48975b7e6b8cc15edc5c51e69d0/family2 of d597a48975b7e6b8cc15edc5c51e69d0 into 71bd4473d5bc428ba9c2ee49530d3df0(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:54:54,530 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:54:54,530 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:54:54,530 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1., storeName=f39582ea31193f99288921c66f1414f1/family2, priority=12, startTime=1699613691179; duration=1sec 2023-11-10 10:54:54,530 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0., storeName=d597a48975b7e6b8cc15edc5c51e69d0/family2, priority=12, startTime=1699613691257; duration=1sec 2023-11-10 10:54:54,530 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. because compaction request was cancelled 2023-11-10 10:54:54,531 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-10 10:54:54,532 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. because compaction request was cancelled 2023-11-10 10:54:54,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e172cff307714536bb0d686bd6e2b49b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-0b42c39d227a42a8993104198718321b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-459bc95291de45479cfcb92ffe9bc3a7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e9b15f9d5c4243f989ff563415100ef7] to archive 2023-11-10 10:54:54,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:54,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e172cff307714536bb0d686bd6e2b49b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e172cff307714536bb0d686bd6e2b49b 2023-11-10 10:54:54,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-0b42c39d227a42a8993104198718321b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-0b42c39d227a42a8993104198718321b 2023-11-10 10:54:54,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-459bc95291de45479cfcb92ffe9bc3a7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-459bc95291de45479cfcb92ffe9bc3a7 2023-11-10 10:54:54,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e9b15f9d5c4243f989ff563415100ef7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/family2/testCompactionWithHFileLink=f39582ea31193f99288921c66f1414f1-e9b15f9d5c4243f989ff563415100ef7 2023-11-10 10:54:54,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-36d606a02afb4aefb699061789e6c0a9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-248519cd09784e60bc575658432088d4, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-cc6058e4246a4fad97e65932420e9d2b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-01a5b542544f41608d6ed249bbcc68b8] to archive 2023-11-10 10:54:54,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:54:54,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-36d606a02afb4aefb699061789e6c0a9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-36d606a02afb4aefb699061789e6c0a9 2023-11-10 10:54:54,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-248519cd09784e60bc575658432088d4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-248519cd09784e60bc575658432088d4 2023-11-10 10:54:54,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-cc6058e4246a4fad97e65932420e9d2b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-cc6058e4246a4fad97e65932420e9d2b 2023-11-10 10:54:54,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-01a5b542544f41608d6ed249bbcc68b8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/family2/testCompactionWithHFileLink=d597a48975b7e6b8cc15edc5c51e69d0-01a5b542544f41608d6ed249bbcc68b8 2023-11-10 10:54:54,687 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110e03ae654e04d47a28c0a7e6940d71792 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231110e03ae654e04d47a28c0a7e6940d71792 2023-11-10 10:54:54,687 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110cbeade721fd846fa9031f436bd8a46a5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231110cbeade721fd846fa9031f436bd8a46a5 2023-11-10 10:54:54,688 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311105f88dfe3acd54159aa261a20c533feb6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311105f88dfe3acd54159aa261a20c533feb6 2023-11-10 10:54:55,094 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/79e580b275494309912349539eed7df2 2023-11-10 10:54:55,094 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/621f016f7c0c4e6dbf393b4cc43463cd 2023-11-10 10:54:55,094 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/cb076fff38bf47fbaf425b05efa6c793 2023-11-10 10:54:55,518 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311106d17cd41f4334f9b9959858f427cf3a0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311106d17cd41f4334f9b9959858f427cf3a0 2023-11-10 10:54:55,519 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110feed40fc4252471a8b9c3f4a0885f4d9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231110feed40fc4252471a8b9c3f4a0885f4d9 2023-11-10 10:54:55,519 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110a537fabe0d1e478e8b0177b5f6f19384 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231110a537fabe0d1e478e8b0177b5f6f19384 2023-11-10 10:54:55,931 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/9666b143a02f46b8ad712549b0098b4c 2023-11-10 10:54:55,931 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300 2023-11-10 10:54:55,931 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b 2023-11-10 10:54:55,943 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/79e580b275494309912349539eed7df2 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/79e580b275494309912349539eed7df2 2023-11-10 10:54:55,943 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/cb076fff38bf47fbaf425b05efa6c793 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cb076fff38bf47fbaf425b05efa6c793 2023-11-10 10:54:55,943 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/621f016f7c0c4e6dbf393b4cc43463cd as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/621f016f7c0c4e6dbf393b4cc43463cd 2023-11-10 10:54:55,946 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/79e580b275494309912349539eed7df2, entries=4, sequenceid=5, filesize=5.4 K 2023-11-10 10:54:55,946 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cb076fff38bf47fbaf425b05efa6c793, entries=4, sequenceid=5, filesize=5.4 K 2023-11-10 10:54:55,946 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/621f016f7c0c4e6dbf393b4cc43463cd, entries=4, sequenceid=5, filesize=5.4 K 2023-11-10 10:54:55,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300 2023-11-10 10:54:55,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/9666b143a02f46b8ad712549b0098b4c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/9666b143a02f46b8ad712549b0098b4c 2023-11-10 10:54:55,947 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b 2023-11-10 10:54:55,950 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/9666b143a02f46b8ad712549b0098b4c, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:54:55,950 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:54:55,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:54:55,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3df0b49e0178a4ede9f722a9850f8b65 in 1681ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:55,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for aec7f5328d591ab91ad7d6c0448f66ff in 1681ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:55,951 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-10 10:54:55,951 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-10 10:54:55,951 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0cd96916b2d2e727befbf8dce6a73b3b in 1681ms, sequenceid=5, compaction requested=false 2023-11-10 10:54:55,951 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-10 10:54:55,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:54:55,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:54:55,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:54:55,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:55,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:55,952 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-10 10:54:55,953 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-10 10:54:55,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,954 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:55,954 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,954 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-10 10:54:55,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c5d8b48[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:55,955 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-10 10:54:55,955 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,956 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-10 10:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-10 10:54:55,956 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:55,956 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,956 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:55,957 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-10 10:54:55,957 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,957 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,957 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-10 10:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:55,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-10 10:54:55,959 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-10 10:54:55,959 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:55,959 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:55,959 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-10 10:54:55,959 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:55,960 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:55,960 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:55,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:55,960 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:55,961 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,961 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:55,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-10 10:54:55,963 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:55,963 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:55,963 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:55,964 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:56,064 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:56,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:56,067 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:56,067 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:56,067 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:56,071 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:56,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:56,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-10 10:54:56,073 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-10 10:54:56,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:56,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-10 10:54:56,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-10 10:54:56,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:56,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:56,076 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:56,076 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:56,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:56,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:56,076 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:56,077 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:56,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:56,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:56,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:56,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-10 10:54:56,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-10 10:54:56,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-10 10:54:56,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-10 10:54:56,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:56,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-10 10:54:56,082 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:56,082 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. started... 2023-11-10 10:54:56,082 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:56,083 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aec7f5328d591ab91ad7d6c0448f66ff 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:54:56,083 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:56,083 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:56,083 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:56,083 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. started... 2023-11-10 10:54:56,083 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. started... 2023-11-10 10:54:56,083 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3df0b49e0178a4ede9f722a9850f8b65 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:54:56,083 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0cd96916b2d2e727befbf8dce6a73b3b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:54:56,099 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311109bd6e8e91f3f490da9d9cab2dcdef107 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311109bd6e8e91f3f490da9d9cab2dcdef107 2023-11-10 10:54:56,100 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110d659177858c045f9ae02f40c6cd5213c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231110d659177858c045f9ae02f40c6cd5213c 2023-11-10 10:54:56,506 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/8a8a6aa887db4d01977842ddea91327c 2023-11-10 10:54:56,506 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/ceb1d5b56237442f8f69eb1306280ff6 2023-11-10 10:54:56,509 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111084d28b5a558749c295709e76bb7e6cbd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111084d28b5a558749c295709e76bb7e6cbd 2023-11-10 10:54:56,917 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/bc6f5188e985471b84ea78e278dcc69a 2023-11-10 10:54:56,928 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110e0f5459b4bdf4fd9a93c11f4150f946a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231110e0f5459b4bdf4fd9a93c11f4150f946a 2023-11-10 10:54:56,928 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110d866020bf207422ab0a0b51c76db8fa5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231110d866020bf207422ab0a0b51c76db8fa5 2023-11-10 10:54:57,337 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/d465ce3072ec4bf094ff0ba734722afd 2023-11-10 10:54:57,343 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/372a547cab424e31a348c270b52b3794 2023-11-10 10:54:57,348 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/8a8a6aa887db4d01977842ddea91327c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/8a8a6aa887db4d01977842ddea91327c 2023-11-10 10:54:57,350 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110f01d1fcd6e434bfeb8565207020817c5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231110f01d1fcd6e434bfeb8565207020817c5 2023-11-10 10:54:57,351 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/ceb1d5b56237442f8f69eb1306280ff6 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/ceb1d5b56237442f8f69eb1306280ff6 2023-11-10 10:54:57,353 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/8a8a6aa887db4d01977842ddea91327c, entries=4, sequenceid=9, filesize=5.4 K 2023-11-10 10:54:57,354 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/d465ce3072ec4bf094ff0ba734722afd as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/d465ce3072ec4bf094ff0ba734722afd 2023-11-10 10:54:57,356 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/ceb1d5b56237442f8f69eb1306280ff6, entries=4, sequenceid=9, filesize=5.4 K 2023-11-10 10:54:57,357 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/372a547cab424e31a348c270b52b3794 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/372a547cab424e31a348c270b52b3794 2023-11-10 10:54:57,358 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/d465ce3072ec4bf094ff0ba734722afd, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:54:57,358 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0cd96916b2d2e727befbf8dce6a73b3b in 1275ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:57,358 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:54:57,359 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:57,359 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:57,359 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/372a547cab424e31a348c270b52b3794, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:54:57,360 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for aec7f5328d591ab91ad7d6c0448f66ff in 1277ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:57,360 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:54:57,360 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:57,360 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:57,757 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/dba9a2b38662411a863a78819fe591e3 2023-11-10 10:54:57,769 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/bc6f5188e985471b84ea78e278dcc69a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/bc6f5188e985471b84ea78e278dcc69a 2023-11-10 10:54:57,777 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/bc6f5188e985471b84ea78e278dcc69a, entries=4, sequenceid=9, filesize=5.4 K 2023-11-10 10:54:57,778 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/dba9a2b38662411a863a78819fe591e3 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/dba9a2b38662411a863a78819fe591e3 2023-11-10 10:54:57,784 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/dba9a2b38662411a863a78819fe591e3, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:54:57,785 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3df0b49e0178a4ede9f722a9850f8b65 in 1701ms, sequenceid=9, compaction requested=false 2023-11-10 10:54:57,785 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:54:57,785 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:57,785 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:57,785 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:57,785 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,785 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-10 10:54:57,785 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-10 10:54:57,787 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:57,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:57,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-10 10:54:57,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43e3b2de[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:57,790 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-10 10:54:57,790 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,791 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,791 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-10 10:54:57,791 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-10 10:54:57,791 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:57,791 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,792 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:57,793 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-10 10:54:57,793 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:57,793 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-10 10:54:57,793 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:57,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:57,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:57,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:57,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:57,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:57,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:57,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-10 10:54:57,798 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-10 10:54:57,799 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:57,799 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:57,799 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-10 10:54:57,799 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:57,801 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,801 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,801 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:57,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:57,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:57,802 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:57,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:57,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,805 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:57,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:57,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,821 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,821 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:57,821 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:57,822 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:57,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-10 10:54:57,822 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:57,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:57,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:57,822 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:57,822 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,822 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:57,822 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,822 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:57,823 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:57,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:57,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:57,822 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:57,823 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,923 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:57,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:57,924 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:57,925 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:57,925 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:57,927 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:57,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:57,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-10 10:54:57,929 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-10 10:54:57,929 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:57,929 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-10 10:54:57,929 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-10 10:54:57,929 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,929 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:57,930 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,930 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:57,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:57,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:57,930 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:57,931 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:57,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:57,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:57,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-10 10:54:57,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-10 10:54:57,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-10 10:54:57,932 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-10 10:54:57,932 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:57,932 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-10 10:54:57,932 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:57,932 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. started... 2023-11-10 10:54:57,932 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:57,932 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. started... 2023-11-10 10:54:57,932 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aec7f5328d591ab91ad7d6c0448f66ff 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:54:57,932 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3df0b49e0178a4ede9f722a9850f8b65 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:54:57,933 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:57,933 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:57,933 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:57,933 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. started... 2023-11-10 10:54:57,933 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0cd96916b2d2e727befbf8dce6a73b3b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:54:57,954 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311103af26a4b82c8458b816c235b327377b8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311103af26a4b82c8458b816c235b327377b8 2023-11-10 10:54:58,356 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110e0306c31f474456492571b384bbd9ee5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231110e0306c31f474456492571b384bbd9ee5 2023-11-10 10:54:58,357 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311101dc0e8f9bb154972a423ae3dc61ef301 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311101dc0e8f9bb154972a423ae3dc61ef301 2023-11-10 10:54:58,359 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/1c1d6a24bacb4e509018a5c6bcbbaabe 2023-11-10 10:54:58,361 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/182b9195c5a74502a291640a4605847d 2023-11-10 10:54:58,763 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/626704c917554361b8421aa4c12b79b9 2023-11-10 10:54:58,776 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110f1578db2ee29442a91676cf397777f90 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231110f1578db2ee29442a91676cf397777f90 2023-11-10 10:54:58,778 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311107cebb06943ed440abaee789951acdbdb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311107cebb06943ed440abaee789951acdbdb 2023-11-10 10:54:58,786 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/192778e9dbc84b43bed151ebe5aeec4d 2023-11-10 10:54:58,788 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111088058e61eec7460a843df26304f40564 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023111088058e61eec7460a843df26304f40564 2023-11-10 10:54:58,789 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/182b9195c5a74502a291640a4605847d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/182b9195c5a74502a291640a4605847d 2023-11-10 10:54:58,790 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:54:58,793 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/182b9195c5a74502a291640a4605847d, entries=4, sequenceid=13, filesize=5.4 K 2023-11-10 10:54:58,794 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/192778e9dbc84b43bed151ebe5aeec4d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/192778e9dbc84b43bed151ebe5aeec4d 2023-11-10 10:54:58,795 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/b0b12d891da7463d9b48eb516bba1d1c 2023-11-10 10:54:58,797 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/192778e9dbc84b43bed151ebe5aeec4d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:54:58,798 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3df0b49e0178a4ede9f722a9850f8b65 in 866ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:58,798 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:54:58,798 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:58,798 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:54:58,799 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/626704c917554361b8421aa4c12b79b9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/626704c917554361b8421aa4c12b79b9 2023-11-10 10:54:58,803 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/626704c917554361b8421aa4c12b79b9, entries=4, sequenceid=13, filesize=5.4 K 2023-11-10 10:54:58,803 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/b0b12d891da7463d9b48eb516bba1d1c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/b0b12d891da7463d9b48eb516bba1d1c 2023-11-10 10:54:58,807 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/b0b12d891da7463d9b48eb516bba1d1c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:54:58,807 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for aec7f5328d591ab91ad7d6c0448f66ff in 875ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:58,808 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:54:58,808 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:58,808 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:54:59,185 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/9593618f07574e7ca225bf8c1f181d58 2023-11-10 10:54:59,195 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/1c1d6a24bacb4e509018a5c6bcbbaabe as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/1c1d6a24bacb4e509018a5c6bcbbaabe 2023-11-10 10:54:59,200 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/1c1d6a24bacb4e509018a5c6bcbbaabe, entries=4, sequenceid=13, filesize=5.4 K 2023-11-10 10:54:59,201 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/9593618f07574e7ca225bf8c1f181d58 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/9593618f07574e7ca225bf8c1f181d58 2023-11-10 10:54:59,208 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/9593618f07574e7ca225bf8c1f181d58, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:54:59,209 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0cd96916b2d2e727befbf8dce6a73b3b in 1276ms, sequenceid=13, compaction requested=true 2023-11-10 10:54:59,209 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:54:59,209 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:59,209 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:54:59,209 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:54:59,209 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,209 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-10 10:54:59,209 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-10 10:54:59,211 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,211 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:59,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:59,212 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,212 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:54:59,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:59,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-10 10:54:59,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21d38234[Count = 0] remaining members to acquire global barrier 2023-11-10 10:54:59,215 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-10 10:54:59,215 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,216 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,216 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-10 10:54:59,216 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-10 10:54:59,216 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:54:59,216 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,216 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:54:59,218 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-10 10:54:59,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:59,218 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-10 10:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:59,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:54:59,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-10 10:54:59,222 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-10 10:54:59,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:54:59,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:54:59,222 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-10 10:54:59,222 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:54:59,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,223 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,224 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:59,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:54:59,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:54:59,224 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:54:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,225 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:54:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:54:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:54:59,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:59,226 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-10 10:54:59,227 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:54:59,226 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:54:59,226 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,227 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:54:59,227 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:54:59,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:54:59,227 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-10 10:54:59,227 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:54:59,327 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:54:59,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:54:59,330 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:59,330 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:59,330 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:54:59,334 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:54:59,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-10 10:54:59,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-10 10:54:59,337 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-10 10:54:59,337 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:59,337 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-10 10:54:59,337 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-10 10:54:59,338 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,338 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:59,339 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:54:59,339 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:54:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:54:59,340 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:54:59,340 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:54:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:59,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:54:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:54:59,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:54:59,341 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-10 10:54:59,342 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-10 10:54:59,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-10 10:54:59,342 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-10 10:54:59,342 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:54:59,342 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-10 10:54:59,342 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:54:59,342 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. started... 2023-11-10 10:54:59,342 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:54:59,342 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. started... 2023-11-10 10:54:59,342 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aec7f5328d591ab91ad7d6c0448f66ff 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:54:59,343 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3df0b49e0178a4ede9f722a9850f8b65 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:54:59,343 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:54:59,343 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:54:59,343 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:54:59,343 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. started... 2023-11-10 10:54:59,343 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0cd96916b2d2e727befbf8dce6a73b3b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:54:59,762 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111036d024f4ed3c4e4994c62b520e28191a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111036d024f4ed3c4e4994c62b520e28191a 2023-11-10 10:54:59,763 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111038f99fbae584427388457859a9e7659d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111038f99fbae584427388457859a9e7659d 2023-11-10 10:54:59,763 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111051fc7213ca81405d927e7c67a2120253 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023111051fc7213ca81405d927e7c67a2120253 2023-11-10 10:55:00,168 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/6f8a0b869ed34687977a199fea0fc0f2 2023-11-10 10:55:00,169 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/63e0f1505fd04606acb5800a9cb476e3 2023-11-10 10:55:00,169 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/7ee724ef172341af8300d7f9141e3c3b 2023-11-10 10:55:00,184 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110ce35ef29c8d047e7a12fe3c2c9ce0067 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231110ce35ef29c8d047e7a12fe3c2c9ce0067 2023-11-10 10:55:00,589 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/a9e78e72975c4e03941be78ad498a92a 2023-11-10 10:55:00,592 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311105dcf08399691445e8fced83d62bdd884 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311105dcf08399691445e8fced83d62bdd884 2023-11-10 10:55:00,592 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110b958294649614ccba92f19c871f49c4c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231110b958294649614ccba92f19c871f49c4c 2023-11-10 10:55:00,595 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/6f8a0b869ed34687977a199fea0fc0f2 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/6f8a0b869ed34687977a199fea0fc0f2 2023-11-10 10:55:00,600 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/6f8a0b869ed34687977a199fea0fc0f2, entries=4, sequenceid=17, filesize=5.4 K 2023-11-10 10:55:00,600 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/a9e78e72975c4e03941be78ad498a92a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/a9e78e72975c4e03941be78ad498a92a 2023-11-10 10:55:00,604 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/a9e78e72975c4e03941be78ad498a92a, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:55:00,605 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3df0b49e0178a4ede9f722a9850f8b65 in 1262ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:00,605 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:55:00,605 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:00,605 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:01,000 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/b283b46b683a49ef9838da468f898beb 2023-11-10 10:55:01,000 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/36f72bef94fd4034a9826eb5f5718c50 2023-11-10 10:55:01,010 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/63e0f1505fd04606acb5800a9cb476e3 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/63e0f1505fd04606acb5800a9cb476e3 2023-11-10 10:55:01,010 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/7ee724ef172341af8300d7f9141e3c3b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/7ee724ef172341af8300d7f9141e3c3b 2023-11-10 10:55:01,014 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/63e0f1505fd04606acb5800a9cb476e3, entries=4, sequenceid=17, filesize=5.4 K 2023-11-10 10:55:01,015 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/7ee724ef172341af8300d7f9141e3c3b, entries=4, sequenceid=17, filesize=5.4 K 2023-11-10 10:55:01,015 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/b283b46b683a49ef9838da468f898beb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/b283b46b683a49ef9838da468f898beb 2023-11-10 10:55:01,016 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/36f72bef94fd4034a9826eb5f5718c50 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/36f72bef94fd4034a9826eb5f5718c50 2023-11-10 10:55:01,021 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/36f72bef94fd4034a9826eb5f5718c50, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:55:01,021 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/b283b46b683a49ef9838da468f898beb, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:55:01,021 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0cd96916b2d2e727befbf8dce6a73b3b in 1678ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:01,021 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for aec7f5328d591ab91ad7d6c0448f66ff in 1679ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:01,022 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:55:01,022 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:55:01,022 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:01,022 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:01,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:01,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:01,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:01,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-10 10:55:01,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-10 10:55:01,024 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:01,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:01,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:01,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-10 10:55:01,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e2d72b5[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:01,026 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-10 10:55:01,026 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,027 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,027 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-10 10:55:01,027 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-10 10:55:01,027 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:01,027 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,027 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:01,028 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,028 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-10 10:55:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:01,028 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:01,028 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-10 10:55:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:01,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:01,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-10 10:55:01,031 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-10 10:55:01,031 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:01,031 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:01,031 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-10 10:55:01,031 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:01,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:01,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:01,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:01,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:01,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:01,033 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:01,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:01,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:01,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,034 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:01,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:01,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:01,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:01,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-10 10:55:01,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:01,036 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:01,036 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:01,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:01,037 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:01,037 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:01,137 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:01,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:01,155 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:01,162 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:01,169 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:01,170 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:01,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:01,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:01,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-10 10:55:01,202 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-10 10:55:01,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:01,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-10 10:55:01,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-10 10:55:01,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,202 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:01,204 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,204 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:01,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:01,204 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:01,204 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:01,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:01,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-10 10:55:01,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-10 10:55:01,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-10 10:55:01,206 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-10 10:55:01,206 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:01,206 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-10 10:55:01,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:01,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. started... 2023-11-10 10:55:01,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:01,206 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing aec7f5328d591ab91ad7d6c0448f66ff 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:55:01,207 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:01,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. started... 2023-11-10 10:55:01,206 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:55:01,207 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3df0b49e0178a4ede9f722a9850f8b65 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:55:01,207 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:01,207 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. started... 2023-11-10 10:55:01,207 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0cd96916b2d2e727befbf8dce6a73b3b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:55:01,633 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/a335ca3baa8544cc9a977a2e4fe50102 2023-11-10 10:55:01,639 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a335ca3baa8544cc9a977a2e4fe50102 2023-11-10 10:55:02,038 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6 2023-11-10 10:55:02,038 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/ada993a185284bc592bf15c469ae9c4d 2023-11-10 10:55:02,043 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd1dc89a3f0b4d1a8d1134c45d6dcdf6 2023-11-10 10:55:02,044 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ada993a185284bc592bf15c469ae9c4d 2023-11-10 10:55:02,452 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/516d8f0bb56d4f1fa2607fa695ac18a9 2023-11-10 10:55:02,456 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 516d8f0bb56d4f1fa2607fa695ac18a9 2023-11-10 10:55:02,456 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/a335ca3baa8544cc9a977a2e4fe50102 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/a335ca3baa8544cc9a977a2e4fe50102 2023-11-10 10:55:02,460 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a335ca3baa8544cc9a977a2e4fe50102 2023-11-10 10:55:02,460 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/a335ca3baa8544cc9a977a2e4fe50102, entries=3, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:02,461 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/516d8f0bb56d4f1fa2607fa695ac18a9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/516d8f0bb56d4f1fa2607fa695ac18a9 2023-11-10 10:55:02,464 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 516d8f0bb56d4f1fa2607fa695ac18a9 2023-11-10 10:55:02,464 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/516d8f0bb56d4f1fa2607fa695ac18a9, entries=1, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:02,465 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3df0b49e0178a4ede9f722a9850f8b65 in 1258ms, sequenceid=23, compaction requested=true 2023-11-10 10:55:02,465 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:55:02,465 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:02,465 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:02,858 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/0e0658b0e4a3404399c80d7bbb72d4cc 2023-11-10 10:55:02,858 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/23de52303cbe4e66976c6672c4ee5d11 2023-11-10 10:55:02,868 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e0658b0e4a3404399c80d7bbb72d4cc 2023-11-10 10:55:02,868 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23de52303cbe4e66976c6672c4ee5d11 2023-11-10 10:55:02,868 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6 2023-11-10 10:55:02,869 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/ada993a185284bc592bf15c469ae9c4d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/ada993a185284bc592bf15c469ae9c4d 2023-11-10 10:55:02,873 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ada993a185284bc592bf15c469ae9c4d 2023-11-10 10:55:02,873 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/ada993a185284bc592bf15c469ae9c4d, entries=3, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:02,874 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd1dc89a3f0b4d1a8d1134c45d6dcdf6 2023-11-10 10:55:02,874 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6, entries=3, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:02,874 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/23de52303cbe4e66976c6672c4ee5d11 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/23de52303cbe4e66976c6672c4ee5d11 2023-11-10 10:55:02,875 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/0e0658b0e4a3404399c80d7bbb72d4cc as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/0e0658b0e4a3404399c80d7bbb72d4cc 2023-11-10 10:55:02,879 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23de52303cbe4e66976c6672c4ee5d11 2023-11-10 10:55:02,879 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e0658b0e4a3404399c80d7bbb72d4cc 2023-11-10 10:55:02,879 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/23de52303cbe4e66976c6672c4ee5d11, entries=1, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:02,879 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/0e0658b0e4a3404399c80d7bbb72d4cc, entries=1, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:02,880 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0cd96916b2d2e727befbf8dce6a73b3b in 1673ms, sequenceid=23, compaction requested=true 2023-11-10 10:55:02,880 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for aec7f5328d591ab91ad7d6c0448f66ff in 1674ms, sequenceid=23, compaction requested=true 2023-11-10 10:55:02,880 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:55:02,880 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:55:02,880 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:02,880 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:02,880 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:02,880 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:02,880 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:02,880 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,880 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-10 10:55:02,880 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-10 10:55:02,881 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,881 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:02,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:02,881 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,882 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:02,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-10 10:55:02,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4eeabff3[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:02,884 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-10 10:55:02,884 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,885 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,885 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-10 10:55:02,885 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-10 10:55:02,885 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:02,885 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,885 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:02,886 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-10 10:55:02,886 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:02,886 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,886 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-10 10:55:02,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:02,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:02,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:02,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:02,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:02,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:02,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:02,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-10 10:55:02,889 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-10 10:55:02,889 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:02,889 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:02,889 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-10 10:55:02,889 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:02,890 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,890 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:02,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,891 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:02,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:02,891 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:02,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:02,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,893 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:02,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-10 10:55:02,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:02,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:02,895 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-10 10:55:02,895 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:02,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-10 10:55:02,895 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:02,895 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:02,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:02,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:02,896 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,896 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:02,896 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-10 10:55:02,896 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-10 10:55:02,996 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:02,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:02,997 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:02,997 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): aec7f5328d591ab91ad7d6c0448f66ff/family1 is initiating major compaction (all files) 2023-11-10 10:55:02,997 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:02,997 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:02,997 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of aec7f5328d591ab91ad7d6c0448f66ff/family1 in ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:02,998 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cb076fff38bf47fbaf425b05efa6c793, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/ceb1d5b56237442f8f69eb1306280ff6, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/626704c917554361b8421aa4c12b79b9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/7ee724ef172341af8300d7f9141e3c3b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp, totalSize=26.6 K 2023-11-10 10:55:02,998 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting cb076fff38bf47fbaf425b05efa6c793, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613694260 2023-11-10 10:55:02,999 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting ceb1d5b56237442f8f69eb1306280ff6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613696067 2023-11-10 10:55:02,999 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 626704c917554361b8421aa4c12b79b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613697924 2023-11-10 10:55:03,000 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 7ee724ef172341af8300d7f9141e3c3b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613699330 2023-11-10 10:55:03,000 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting cd1dc89a3f0b4d1a8d1134c45d6dcdf6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:03,013 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): aec7f5328d591ab91ad7d6c0448f66ff#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:03,428 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231110d6bb134f7eff4a529b77c39453eebfea_del 2023-11-10 10:55:03,428 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110d6bb134f7eff4a529b77c39453eebfea_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231110d6bb134f7eff4a529b77c39453eebfea_del 2023-11-10 10:55:04,254 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a606cc6cc5e84e7ca5fd2c79a96971b3 2023-11-10 10:55:04,255 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family1/a606cc6cc5e84e7ca5fd2c79a96971b3 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/a606cc6cc5e84e7ca5fd2c79a96971b3 2023-11-10 10:55:04,261 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a606cc6cc5e84e7ca5fd2c79a96971b3 2023-11-10 10:55:04,262 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aec7f5328d591ab91ad7d6c0448f66ff/family1 of aec7f5328d591ab91ad7d6c0448f66ff into a606cc6cc5e84e7ca5fd2c79a96971b3(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:55:04,262 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:55:04,263 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:04,263 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): aec7f5328d591ab91ad7d6c0448f66ff/family2 is initiating major compaction (all files) 2023-11-10 10:55:04,263 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:04,263 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:04,263 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of aec7f5328d591ab91ad7d6c0448f66ff/family2 in ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:04,263 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/9666b143a02f46b8ad712549b0098b4c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/372a547cab424e31a348c270b52b3794, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/b0b12d891da7463d9b48eb516bba1d1c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/36f72bef94fd4034a9826eb5f5718c50, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/0e0658b0e4a3404399c80d7bbb72d4cc] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp, totalSize=25.3 K 2023-11-10 10:55:04,264 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 9666b143a02f46b8ad712549b0098b4c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613694260 2023-11-10 10:55:04,264 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 372a547cab424e31a348c270b52b3794, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613696067 2023-11-10 10:55:04,265 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting b0b12d891da7463d9b48eb516bba1d1c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613697924 2023-11-10 10:55:04,266 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 36f72bef94fd4034a9826eb5f5718c50, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613699330 2023-11-10 10:55:04,266 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 0e0658b0e4a3404399c80d7bbb72d4cc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:04,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cb076fff38bf47fbaf425b05efa6c793, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/ceb1d5b56237442f8f69eb1306280ff6, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/626704c917554361b8421aa4c12b79b9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/7ee724ef172341af8300d7f9141e3c3b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6] to archive 2023-11-10 10:55:04,281 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): aec7f5328d591ab91ad7d6c0448f66ff#family2#compaction#151 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:04,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:04,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cb076fff38bf47fbaf425b05efa6c793 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cb076fff38bf47fbaf425b05efa6c793 2023-11-10 10:55:04,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/ceb1d5b56237442f8f69eb1306280ff6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/ceb1d5b56237442f8f69eb1306280ff6 2023-11-10 10:55:04,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/626704c917554361b8421aa4c12b79b9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/626704c917554361b8421aa4c12b79b9 2023-11-10 10:55:04,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/7ee724ef172341af8300d7f9141e3c3b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/7ee724ef172341af8300d7f9141e3c3b 2023-11-10 10:55:04,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/cd1dc89a3f0b4d1a8d1134c45d6dcdf6 2023-11-10 10:55:04,701 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311102204d750d3764d35960a660139fdd19e_del 2023-11-10 10:55:04,702 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311102204d750d3764d35960a660139fdd19e_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311102204d750d3764d35960a660139fdd19e_del 2023-11-10 10:55:05,121 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10d1531c58954d19b3c0deab9fcf7805 2023-11-10 10:55:05,122 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/.tmp/family2/10d1531c58954d19b3c0deab9fcf7805 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/10d1531c58954d19b3c0deab9fcf7805 2023-11-10 10:55:05,128 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 10d1531c58954d19b3c0deab9fcf7805 2023-11-10 10:55:05,130 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aec7f5328d591ab91ad7d6c0448f66ff/family2 of aec7f5328d591ab91ad7d6c0448f66ff into 10d1531c58954d19b3c0deab9fcf7805(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:05,130 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:55:05,130 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:05,130 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 3df0b49e0178a4ede9f722a9850f8b65/family1 is initiating major compaction (all files) 2023-11-10 10:55:05,130 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:05,130 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:05,131 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 3df0b49e0178a4ede9f722a9850f8b65/family1 in ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:05,131 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/79e580b275494309912349539eed7df2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/bc6f5188e985471b84ea78e278dcc69a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/182b9195c5a74502a291640a4605847d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/6f8a0b869ed34687977a199fea0fc0f2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/a335ca3baa8544cc9a977a2e4fe50102] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp, totalSize=26.6 K 2023-11-10 10:55:05,131 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 79e580b275494309912349539eed7df2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613694261 2023-11-10 10:55:05,132 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting bc6f5188e985471b84ea78e278dcc69a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613696067 2023-11-10 10:55:05,132 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 182b9195c5a74502a291640a4605847d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613697925 2023-11-10 10:55:05,133 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 6f8a0b869ed34687977a199fea0fc0f2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613699330 2023-11-10 10:55:05,133 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting a335ca3baa8544cc9a977a2e4fe50102, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:05,143 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 3df0b49e0178a4ede9f722a9850f8b65#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:05,150 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231110b956cea303cb46f2978724a4e97d89f5_del 2023-11-10 10:55:05,150 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110b956cea303cb46f2978724a4e97d89f5_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231110b956cea303cb46f2978724a4e97d89f5_del 2023-11-10 10:55:05,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/9666b143a02f46b8ad712549b0098b4c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/372a547cab424e31a348c270b52b3794, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/b0b12d891da7463d9b48eb516bba1d1c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/36f72bef94fd4034a9826eb5f5718c50, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/0e0658b0e4a3404399c80d7bbb72d4cc] to archive 2023-11-10 10:55:05,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:05,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/9666b143a02f46b8ad712549b0098b4c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/9666b143a02f46b8ad712549b0098b4c 2023-11-10 10:55:05,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/372a547cab424e31a348c270b52b3794 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/372a547cab424e31a348c270b52b3794 2023-11-10 10:55:05,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/b0b12d891da7463d9b48eb516bba1d1c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/b0b12d891da7463d9b48eb516bba1d1c 2023-11-10 10:55:05,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/36f72bef94fd4034a9826eb5f5718c50 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/36f72bef94fd4034a9826eb5f5718c50 2023-11-10 10:55:05,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/0e0658b0e4a3404399c80d7bbb72d4cc to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family2/0e0658b0e4a3404399c80d7bbb72d4cc 2023-11-10 10:55:05,978 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cb66c95a05c4f6fbcc9be58e054d124 2023-11-10 10:55:05,979 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family1/9cb66c95a05c4f6fbcc9be58e054d124 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/9cb66c95a05c4f6fbcc9be58e054d124 2023-11-10 10:55:05,988 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9cb66c95a05c4f6fbcc9be58e054d124 2023-11-10 10:55:05,989 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3df0b49e0178a4ede9f722a9850f8b65/family1 of 3df0b49e0178a4ede9f722a9850f8b65 into 9cb66c95a05c4f6fbcc9be58e054d124(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:05,989 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:55:05,989 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:05,989 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 3df0b49e0178a4ede9f722a9850f8b65/family2 is initiating major compaction (all files) 2023-11-10 10:55:05,990 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:05,990 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:05,990 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 3df0b49e0178a4ede9f722a9850f8b65/family2 in ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:05,990 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/dba9a2b38662411a863a78819fe591e3, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/192778e9dbc84b43bed151ebe5aeec4d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/a9e78e72975c4e03941be78ad498a92a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/516d8f0bb56d4f1fa2607fa695ac18a9] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp, totalSize=25.3 K 2023-11-10 10:55:05,991 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 1c85f9f4e7eb4e6a8e2fd0d85fc91300, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613694261 2023-11-10 10:55:05,991 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting dba9a2b38662411a863a78819fe591e3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613696067 2023-11-10 10:55:05,991 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 192778e9dbc84b43bed151ebe5aeec4d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613697925 2023-11-10 10:55:05,992 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting a9e78e72975c4e03941be78ad498a92a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613699330 2023-11-10 10:55:05,992 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 516d8f0bb56d4f1fa2607fa695ac18a9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:06,001 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 3df0b49e0178a4ede9f722a9850f8b65#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:06,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/79e580b275494309912349539eed7df2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/bc6f5188e985471b84ea78e278dcc69a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/182b9195c5a74502a291640a4605847d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/6f8a0b869ed34687977a199fea0fc0f2, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/a335ca3baa8544cc9a977a2e4fe50102] to archive 2023-11-10 10:55:06,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:06,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/79e580b275494309912349539eed7df2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/79e580b275494309912349539eed7df2 2023-11-10 10:55:06,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/bc6f5188e985471b84ea78e278dcc69a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/bc6f5188e985471b84ea78e278dcc69a 2023-11-10 10:55:06,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/182b9195c5a74502a291640a4605847d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/182b9195c5a74502a291640a4605847d 2023-11-10 10:55:06,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/6f8a0b869ed34687977a199fea0fc0f2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/6f8a0b869ed34687977a199fea0fc0f2 2023-11-10 10:55:06,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/a335ca3baa8544cc9a977a2e4fe50102 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/a335ca3baa8544cc9a977a2e4fe50102 2023-11-10 10:55:06,418 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311108fa131a711b0439fa4f2d0ac4ae35cf8_del 2023-11-10 10:55:06,418 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311108fa131a711b0439fa4f2d0ac4ae35cf8_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311108fa131a711b0439fa4f2d0ac4ae35cf8_del 2023-11-10 10:55:06,842 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fcf8588c3a047549e0cb7b58313056d 2023-11-10 10:55:06,843 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/.tmp/family2/1fcf8588c3a047549e0cb7b58313056d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1fcf8588c3a047549e0cb7b58313056d 2023-11-10 10:55:06,850 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fcf8588c3a047549e0cb7b58313056d 2023-11-10 10:55:06,851 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3df0b49e0178a4ede9f722a9850f8b65/family2 of 3df0b49e0178a4ede9f722a9850f8b65 into 1fcf8588c3a047549e0cb7b58313056d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:06,851 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:55:06,851 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:06,851 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 0cd96916b2d2e727befbf8dce6a73b3b/family1 is initiating major compaction (all files) 2023-11-10 10:55:06,852 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:06,852 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:06,852 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 0cd96916b2d2e727befbf8dce6a73b3b/family1 in ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:06,852 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/621f016f7c0c4e6dbf393b4cc43463cd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/8a8a6aa887db4d01977842ddea91327c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/1c1d6a24bacb4e509018a5c6bcbbaabe, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/63e0f1505fd04606acb5800a9cb476e3, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/ada993a185284bc592bf15c469ae9c4d] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp, totalSize=26.6 K 2023-11-10 10:55:06,853 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 621f016f7c0c4e6dbf393b4cc43463cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613694261 2023-11-10 10:55:06,853 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 8a8a6aa887db4d01977842ddea91327c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613696067 2023-11-10 10:55:06,854 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 1c1d6a24bacb4e509018a5c6bcbbaabe, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613697925 2023-11-10 10:55:06,854 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 63e0f1505fd04606acb5800a9cb476e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613699330 2023-11-10 10:55:06,855 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting ada993a185284bc592bf15c469ae9c4d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:06,868 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 0cd96916b2d2e727befbf8dce6a73b3b#family1#compaction#154 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:06,879 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311100ff72a55bc8f4c1694ac41dc7cda82a8_del 2023-11-10 10:55:06,879 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311100ff72a55bc8f4c1694ac41dc7cda82a8_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311100ff72a55bc8f4c1694ac41dc7cda82a8_del 2023-11-10 10:55:06,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/dba9a2b38662411a863a78819fe591e3, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/192778e9dbc84b43bed151ebe5aeec4d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/a9e78e72975c4e03941be78ad498a92a, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/516d8f0bb56d4f1fa2607fa695ac18a9] to archive 2023-11-10 10:55:06,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:06,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/1c85f9f4e7eb4e6a8e2fd0d85fc91300 2023-11-10 10:55:06,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/dba9a2b38662411a863a78819fe591e3 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/dba9a2b38662411a863a78819fe591e3 2023-11-10 10:55:06,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/192778e9dbc84b43bed151ebe5aeec4d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/192778e9dbc84b43bed151ebe5aeec4d 2023-11-10 10:55:06,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/a9e78e72975c4e03941be78ad498a92a to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/a9e78e72975c4e03941be78ad498a92a 2023-11-10 10:55:06,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/516d8f0bb56d4f1fa2607fa695ac18a9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family2/516d8f0bb56d4f1fa2607fa695ac18a9 2023-11-10 10:55:07,704 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d2323be33154d4994109e7978c56996 2023-11-10 10:55:07,705 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family1/6d2323be33154d4994109e7978c56996 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/6d2323be33154d4994109e7978c56996 2023-11-10 10:55:07,712 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d2323be33154d4994109e7978c56996 2023-11-10 10:55:07,713 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0cd96916b2d2e727befbf8dce6a73b3b/family1 of 0cd96916b2d2e727befbf8dce6a73b3b into 6d2323be33154d4994109e7978c56996(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:07,713 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:55:07,713 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:07,713 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 0cd96916b2d2e727befbf8dce6a73b3b/family2 is initiating major compaction (all files) 2023-11-10 10:55:07,713 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:07,713 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:07,713 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 0cd96916b2d2e727befbf8dce6a73b3b/family2 in ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:07,714 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/d465ce3072ec4bf094ff0ba734722afd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/9593618f07574e7ca225bf8c1f181d58, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/b283b46b683a49ef9838da468f898beb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/23de52303cbe4e66976c6672c4ee5d11] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp, totalSize=25.3 K 2023-11-10 10:55:07,714 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 240c52f1f19c4b2d8ccdaaa6f0ba227b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613694261 2023-11-10 10:55:07,715 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting d465ce3072ec4bf094ff0ba734722afd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613696067 2023-11-10 10:55:07,715 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 9593618f07574e7ca225bf8c1f181d58, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613697925 2023-11-10 10:55:07,716 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting b283b46b683a49ef9838da468f898beb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613699330 2023-11-10 10:55:07,717 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 23de52303cbe4e66976c6672c4ee5d11, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:07,730 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 0cd96916b2d2e727befbf8dce6a73b3b#family2#compaction#155 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:07,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/621f016f7c0c4e6dbf393b4cc43463cd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/8a8a6aa887db4d01977842ddea91327c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/1c1d6a24bacb4e509018a5c6bcbbaabe, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/63e0f1505fd04606acb5800a9cb476e3, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/ada993a185284bc592bf15c469ae9c4d] to archive 2023-11-10 10:55:07,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:07,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/621f016f7c0c4e6dbf393b4cc43463cd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/621f016f7c0c4e6dbf393b4cc43463cd 2023-11-10 10:55:07,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/8a8a6aa887db4d01977842ddea91327c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/8a8a6aa887db4d01977842ddea91327c 2023-11-10 10:55:07,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/1c1d6a24bacb4e509018a5c6bcbbaabe to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/1c1d6a24bacb4e509018a5c6bcbbaabe 2023-11-10 10:55:07,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/63e0f1505fd04606acb5800a9cb476e3 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/63e0f1505fd04606acb5800a9cb476e3 2023-11-10 10:55:07,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/ada993a185284bc592bf15c469ae9c4d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/ada993a185284bc592bf15c469ae9c4d 2023-11-10 10:55:08,145 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311105abf40b7f12d42a291d94202cb8ef3dd_del 2023-11-10 10:55:08,146 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311105abf40b7f12d42a291d94202cb8ef3dd_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311105abf40b7f12d42a291d94202cb8ef3dd_del 2023-11-10 10:55:08,975 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a257a79841941edb80ce13f2cce2255 2023-11-10 10:55:08,977 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/.tmp/family2/4a257a79841941edb80ce13f2cce2255 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/4a257a79841941edb80ce13f2cce2255 2023-11-10 10:55:08,982 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a257a79841941edb80ce13f2cce2255 2023-11-10 10:55:08,984 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0cd96916b2d2e727befbf8dce6a73b3b/family2 of 0cd96916b2d2e727befbf8dce6a73b3b into 4a257a79841941edb80ce13f2cce2255(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:55:08,984 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:55:08,989 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:08,994 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:09,000 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:09,001 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:09,007 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-10 10:55:09,024 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-10 10:55:09,027 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231110d6bb134f7eff4a529b77c39453eebfea_del 2023-11-10 10:55:09,029 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231110b956cea303cb46f2978724a4e97d89f5_del 2023-11-10 10:55:09,032 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311100ff72a55bc8f4c1694ac41dc7cda82a8_del 2023-11-10 10:55:09,032 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,033 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(139): Connect 0x3baacf80 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:55:09,037 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1112dfb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:55:09,038 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231110 for table='ns:testMinorCompaction' and column='family1' 2023-11-10 10:55:09,038 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231110 for table='ns:testMinorCompaction' and column='family1' 2023-11-10 10:55:09,038 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231110 for table='ns:testMinorCompaction' and column='family1' 2023-11-10 10:55:09,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/d465ce3072ec4bf094ff0ba734722afd, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/9593618f07574e7ca225bf8c1f181d58, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/b283b46b683a49ef9838da468f898beb, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/23de52303cbe4e66976c6672c4ee5d11] to archive 2023-11-10 10:55:09,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:09,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/240c52f1f19c4b2d8ccdaaa6f0ba227b 2023-11-10 10:55:09,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/d465ce3072ec4bf094ff0ba734722afd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/d465ce3072ec4bf094ff0ba734722afd 2023-11-10 10:55:09,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/9593618f07574e7ca225bf8c1f181d58 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/9593618f07574e7ca225bf8c1f181d58 2023-11-10 10:55:09,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/b283b46b683a49ef9838da468f898beb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/b283b46b683a49ef9838da468f898beb 2023-11-10 10:55:09,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/23de52303cbe4e66976c6672c4ee5d11 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family2/23de52303cbe4e66976c6672c4ee5d11 2023-11-10 10:55:09,462 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111022149de236384a64818a6d16ad7e7ce4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023111022149de236384a64818a6d16ad7e7ce4 2023-11-10 10:55:09,462 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,463 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110e56cfd27bc6d4f7db2e805bf177c1097 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231110e56cfd27bc6d4f7db2e805bf177c1097 2023-11-10 10:55:09,464 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,475 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:55:09,478 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:55:09,483 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:55:09,487 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:55:09,497 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231110/family1/33dc3cd9bead4596987afbc811916079 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-10 10:55:09,500 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231110/family1/33dc3cd9bead4596987afbc811916079}] 2023-11-10 10:55:09,504 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/family1/5af55adb1c6c4adab7bf94296efe1bd2 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-10 10:55:09,505 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231110/family1/33dc3cd9bead4596987afbc811916079 for inclusion in 0cd96916b2d2e727befbf8dce6a73b3b/family1 2023-11-10 10:55:09,505 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/family1/5af55adb1c6c4adab7bf94296efe1bd2}] 2023-11-10 10:55:09,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/family1/5af55adb1c6c4adab7bf94296efe1bd2 for inclusion in aec7f5328d591ab91ad7d6c0448f66ff/family1 2023-11-10 10:55:09,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-10 10:55:09,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-10 10:55:09,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:55:09,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231110/family1/33dc3cd9bead4596987afbc811916079 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__a102dv9gs0s0uu7nmmkvfbeh8jsjceck7f646ehvlnsk14ofb40tdqba25h1sjcc/family1/33dc3cd9bead4596987afbc811916079 2023-11-10 10:55:09,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-10 10:55:09,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last=1 2023-11-10 10:55:09,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:55:09,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231110/family1/5af55adb1c6c4adab7bf94296efe1bd2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__aupska7aovei31e7ft1ui4gvjnsbrkip9k10sj991cuma1p9aghl45iqf4l3mkv7/family1/5af55adb1c6c4adab7bf94296efe1bd2 2023-11-10 10:55:09,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__a102dv9gs0s0uu7nmmkvfbeh8jsjceck7f646ehvlnsk14ofb40tdqba25h1sjcc/family1/33dc3cd9bead4596987afbc811916079 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/412ce71cf0664a99b399fcb28ff9914f_SeqId_28_ 2023-11-10 10:55:09,512 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__a102dv9gs0s0uu7nmmkvfbeh8jsjceck7f646ehvlnsk14ofb40tdqba25h1sjcc/family1/33dc3cd9bead4596987afbc811916079 into 0cd96916b2d2e727befbf8dce6a73b3b/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/412ce71cf0664a99b399fcb28ff9914f_SeqId_28_ - updating store file list. 2023-11-10 10:55:09,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__aupska7aovei31e7ft1ui4gvjnsbrkip9k10sj991cuma1p9aghl45iqf4l3mkv7/family1/5af55adb1c6c4adab7bf94296efe1bd2 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/1ce157044a8543369831bfc6799bbbca_SeqId_28_ 2023-11-10 10:55:09,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__aupska7aovei31e7ft1ui4gvjnsbrkip9k10sj991cuma1p9aghl45iqf4l3mkv7/family1/5af55adb1c6c4adab7bf94296efe1bd2 into aec7f5328d591ab91ad7d6c0448f66ff/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/1ce157044a8543369831bfc6799bbbca_SeqId_28_ - updating store file list. 2023-11-10 10:55:09,515 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/412ce71cf0664a99b399fcb28ff9914f_SeqId_28_ into 0cd96916b2d2e727befbf8dce6a73b3b/family1 2023-11-10 10:55:09,515 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__a102dv9gs0s0uu7nmmkvfbeh8jsjceck7f646ehvlnsk14ofb40tdqba25h1sjcc/family1/33dc3cd9bead4596987afbc811916079 into 0cd96916b2d2e727befbf8dce6a73b3b/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/family1/412ce71cf0664a99b399fcb28ff9914f_SeqId_28_) 2023-11-10 10:55:09,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__a102dv9gs0s0uu7nmmkvfbeh8jsjceck7f646ehvlnsk14ofb40tdqba25h1sjcc/family1/33dc3cd9bead4596987afbc811916079 2023-11-10 10:55:09,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/1ce157044a8543369831bfc6799bbbca_SeqId_28_ into aec7f5328d591ab91ad7d6c0448f66ff/family1 2023-11-10 10:55:09,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__aupska7aovei31e7ft1ui4gvjnsbrkip9k10sj991cuma1p9aghl45iqf4l3mkv7/family1/5af55adb1c6c4adab7bf94296efe1bd2 into aec7f5328d591ab91ad7d6c0448f66ff/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/family1/1ce157044a8543369831bfc6799bbbca_SeqId_28_) 2023-11-10 10:55:09,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__aupska7aovei31e7ft1ui4gvjnsbrkip9k10sj991cuma1p9aghl45iqf4l3mkv7/family1/5af55adb1c6c4adab7bf94296efe1bd2 2023-11-10 10:55:09,517 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,518 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:09,518 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,519 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:09,519 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231110e03ae654e04d47a28c0a7e6940d71792 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231110e03ae654e04d47a28c0a7e6940d71792 2023-11-10 10:55:09,519 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-10 10:55:09,520 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231110' 2023-11-10 10:55:09,520 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231110 for table='ns:testMinorCompaction' and column='family1' 2023-11-10 10:55:09,520 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311105f88dfe3acd54159aa261a20c533feb6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311105f88dfe3acd54159aa261a20c533feb6 2023-11-10 10:55:09,520 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-10 10:55:09,520 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231110' 2023-11-10 10:55:09,520 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231110 for table='ns:testMinorCompaction' and column='family1' 2023-11-10 10:55:09,871 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111018d30c7bc0874052b6e41411f57c52c3 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023111018d30c7bc0874052b6e41411f57c52c3 2023-11-10 10:55:09,873 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,897 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231110/family1/7bf39c313035433abdd25f354c9f70c9 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-10 10:55:09,898 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231110/family1/7bf39c313035433abdd25f354c9f70c9}] 2023-11-10 10:55:09,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231110/family1/7bf39c313035433abdd25f354c9f70c9 for inclusion in 3df0b49e0178a4ede9f722a9850f8b65/family1 2023-11-10 10:55:09,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-10 10:55:09,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-10 10:55:09,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:55:09,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231110/family1/7bf39c313035433abdd25f354c9f70c9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__vtl9oo0v6g3angc7enfnbcdkhtceh2apkcm5pimv36pa4m6ic4rnl7q95idi4sdi/family1/7bf39c313035433abdd25f354c9f70c9 2023-11-10 10:55:09,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__vtl9oo0v6g3angc7enfnbcdkhtceh2apkcm5pimv36pa4m6ic4rnl7q95idi4sdi/family1/7bf39c313035433abdd25f354c9f70c9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/f40fc3cc2b764b23a12c6b38ce0e72a0_SeqId_28_ 2023-11-10 10:55:09,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__vtl9oo0v6g3angc7enfnbcdkhtceh2apkcm5pimv36pa4m6ic4rnl7q95idi4sdi/family1/7bf39c313035433abdd25f354c9f70c9 into 3df0b49e0178a4ede9f722a9850f8b65/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/f40fc3cc2b764b23a12c6b38ce0e72a0_SeqId_28_ - updating store file list. 2023-11-10 10:55:09,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/f40fc3cc2b764b23a12c6b38ce0e72a0_SeqId_28_ into 3df0b49e0178a4ede9f722a9850f8b65/family1 2023-11-10 10:55:09,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__vtl9oo0v6g3angc7enfnbcdkhtceh2apkcm5pimv36pa4m6ic4rnl7q95idi4sdi/family1/7bf39c313035433abdd25f354c9f70c9 into 3df0b49e0178a4ede9f722a9850f8b65/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/family1/f40fc3cc2b764b23a12c6b38ce0e72a0_SeqId_28_) 2023-11-10 10:55:09,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__ns_testMinorCompaction__vtl9oo0v6g3angc7enfnbcdkhtceh2apkcm5pimv36pa4m6ic4rnl7q95idi4sdi/family1/7bf39c313035433abdd25f354c9f70c9 2023-11-10 10:55:09,910 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,911 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:09,912 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231110cbeade721fd846fa9031f436bd8a46a5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231110cbeade721fd846fa9031f436bd8a46a5 2023-11-10 10:55:09,912 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-10 10:55:09,912 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231110' 2023-11-10 10:55:09,912 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231110 for table='ns:testMinorCompaction' and column='family1' 2023-11-10 10:55:09,912 INFO [Listener at localhost/37195] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-10 10:55:09,915 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:09,916 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:09,919 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:09,920 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:09,939 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=252 (was 291), OpenFileDescriptor=659 (was 797), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=93 (was 121), ProcessCount=166 (was 166), AvailableMemoryMB=8316 (was 8333) 2023-11-10 10:55:09,952 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=659, MaxFileDescriptor=60000, SystemLoadAverage=93, ProcessCount=166, AvailableMemoryMB=8315 2023-11-10 10:55:09,954 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-10 10:55:09,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:09,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:55:09,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-10 10:55:09,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:55:09,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-10 10:55:09,958 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:09,959 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6 empty. 2023-11-10 10:55:09,959 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:09,959 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-10 10:55:10,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-10 10:55:10,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-10 10:55:10,369 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-10 10:55:10,372 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec4f0712d47624680cc4de9c9ec57bc6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:55:10,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-10 10:55:10,783 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:10,783 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing ec4f0712d47624680cc4de9c9ec57bc6, disabling compactions & flushes 2023-11-10 10:55:10,783 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:10,783 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:10,783 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. after waiting 0 ms 2023-11-10 10:55:10,783 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:10,783 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:10,783 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:10,787 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:55:10,789 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699613710788"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613710788"}]},"ts":"1699613710788"} 2023-11-10 10:55:10,791 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-10 10:55:10,791 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:55:10,792 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613710791"}]},"ts":"1699613710791"} 2023-11-10 10:55:10,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-10 10:55:10,796 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ec4f0712d47624680cc4de9c9ec57bc6, ASSIGN}] 2023-11-10 10:55:10,797 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ec4f0712d47624680cc4de9c9ec57bc6, ASSIGN 2023-11-10 10:55:10,798 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ec4f0712d47624680cc4de9c9ec57bc6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:55:10,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=ec4f0712d47624680cc4de9c9ec57bc6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:10,950 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699613710949"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613710949"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613710949"}]},"ts":"1699613710949"} 2023-11-10 10:55:10,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure ec4f0712d47624680cc4de9c9ec57bc6, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:55:11,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-10 10:55:11,104 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:11,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:11,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec4f0712d47624680cc4de9c9ec57bc6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.', STARTKEY => '', ENDKEY => ''} 2023-11-10 10:55:11,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:11,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,112 INFO [StoreOpener-ec4f0712d47624680cc4de9c9ec57bc6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,115 DEBUG [StoreOpener-ec4f0712d47624680cc4de9c9ec57bc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:11,115 DEBUG [StoreOpener-ec4f0712d47624680cc4de9c9ec57bc6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:11,116 INFO [StoreOpener-ec4f0712d47624680cc4de9c9ec57bc6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec4f0712d47624680cc4de9c9ec57bc6 columnFamilyName family1 2023-11-10 10:55:11,118 INFO [StoreOpener-ec4f0712d47624680cc4de9c9ec57bc6-1] regionserver.HStore(310): Store=ec4f0712d47624680cc4de9c9ec57bc6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:11,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:11,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:55:11,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ec4f0712d47624680cc4de9c9ec57bc6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59656679, jitterRate=-0.1110462099313736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-10 10:55:11,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:11,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6., pid=114, masterSystemTime=1699613711104 2023-11-10 10:55:11,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:11,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:11,127 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=ec4f0712d47624680cc4de9c9ec57bc6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:11,127 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699613711127"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613711127"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613711127"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613711127"}]},"ts":"1699613711127"} 2023-11-10 10:55:11,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-10 10:55:11,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure ec4f0712d47624680cc4de9c9ec57bc6, server=jenkins-hbase20.apache.org,43721,1699613570510 in 176 msec 2023-11-10 10:55:11,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-10 10:55:11,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=ec4f0712d47624680cc4de9c9ec57bc6, ASSIGN in 333 msec 2023-11-10 10:55:11,130 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:55:11,130 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613711130"}]},"ts":"1699613711130"} 2023-11-10 10:55:11,131 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-10 10:55:11,133 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:55:11,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1790 sec 2023-11-10 10:55:12,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-10 10:55:12,066 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-10 10:55:12,087 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:12,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,088 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:12,088 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:12,088 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:12,088 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:12,089 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,089 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,089 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,089 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:12,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:12,090 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,090 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:12,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:12,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:12,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:12,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:12,094 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:12,094 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:12,095 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:12,095 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-10 10:55:12,521 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113023c4961cdf2f4d64a92ce4d020ca7b2e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113023c4961cdf2f4d64a92ce4d020ca7b2e 2023-11-10 10:55:12,926 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/b2481f24f41f4b18968082f96251e0c5 2023-11-10 10:55:12,931 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/b2481f24f41f4b18968082f96251e0c5 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b2481f24f41f4b18968082f96251e0c5 2023-11-10 10:55:12,935 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b2481f24f41f4b18968082f96251e0c5, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-10 10:55:12,936 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 841ms, sequenceid=5, compaction requested=false 2023-11-10 10:55:12,936 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:12,937 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:12,937 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:12,937 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:12,937 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:12,937 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,937 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:12,937 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:12,939 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,939 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:12,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:12,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:12,940 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,940 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:12,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:12,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:12,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10c191b2[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:12,942 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:12,942 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,943 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,943 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:12,943 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:12,943 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:12,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,943 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:12,944 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:12,944 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,944 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:12,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:12,944 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:12,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:12,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:12,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:12,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:12,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:12,947 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:12,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:12,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:12,947 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,947 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:12,949 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,949 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:12,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:12,949 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:12,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:12,950 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:12,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:12,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:12,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,952 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:12,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:12,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:12,954 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:12,954 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,954 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:12,954 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:12,955 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,955 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:12,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:12,955 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:12,955 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:12,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:12,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:13,055 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:13,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:13,065 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:13,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:13,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,068 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:13,068 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:13,068 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:13,068 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:13,069 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,069 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,071 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:13,071 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:13,071 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,071 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,074 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:13,074 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,074 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:13,074 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:13,075 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:13,075 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:13,075 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:13,075 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:13,075 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:13,075 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-10 10:55:13,496 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288988f455040e4811a66eb04a3a8af716 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288988f455040e4811a66eb04a3a8af716 2023-11-10 10:55:13,503 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/a344e56544d1434ab54336f6dc1a5051 2023-11-10 10:55:13,510 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/a344e56544d1434ab54336f6dc1a5051 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a344e56544d1434ab54336f6dc1a5051 2023-11-10 10:55:13,517 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a344e56544d1434ab54336f6dc1a5051, entries=1, sequenceid=9, filesize=5.0 K 2023-11-10 10:55:13,518 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 443ms, sequenceid=9, compaction requested=false 2023-11-10 10:55:13,518 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:13,518 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:13,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:13,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:13,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:13,518 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:13,522 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,522 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:13,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:13,522 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,522 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:13,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:13,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:13,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:13,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dbe63bc[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:13,526 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:13,526 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,527 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,528 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:13,528 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:13,528 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:13,528 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,528 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:13,529 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:13,529 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,529 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:13,529 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:13,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:13,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:13,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:13,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:13,532 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:13,532 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:13,532 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:13,532 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,532 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:13,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,533 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:13,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,534 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:13,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:13,534 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,535 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:13,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:13,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:13,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:13,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:13,537 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,537 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:13,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:13,638 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:13,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:13,649 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:13,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:13,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,652 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:13,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:13,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:13,653 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:13,654 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,654 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,655 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:13,655 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:13,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:13,656 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:13,656 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:13,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:13,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,658 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,658 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:13,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:13,658 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:13,658 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:13,658 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:13,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:13,659 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:13,659 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:13,659 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:13,659 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:14,077 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120117f1bba357d5457ba8debf8e2ca00c61 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120117f1bba357d5457ba8debf8e2ca00c61 2023-11-10 10:55:14,483 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/a848ad9b9d6347ee92c41c28323b73c5 2023-11-10 10:55:14,493 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/a848ad9b9d6347ee92c41c28323b73c5 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a848ad9b9d6347ee92c41c28323b73c5 2023-11-10 10:55:14,500 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a848ad9b9d6347ee92c41c28323b73c5, entries=1, sequenceid=13, filesize=4.9 K 2023-11-10 10:55:14,501 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 842ms, sequenceid=13, compaction requested=true 2023-11-10 10:55:14,501 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:14,501 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:14,501 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:14,502 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:14,502 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,502 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:14,502 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:14,503 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,503 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:14,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:14,504 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,504 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:14,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:14,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:14,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:14,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:14,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48630464[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:14,506 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:14,506 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,507 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,507 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:14,507 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:14,507 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:14,508 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,508 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:14,508 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:14,509 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:14,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:14,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:14,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:14,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:14,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:14,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:14,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:14,513 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:14,513 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:14,513 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:14,513 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,513 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:14,515 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,515 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:14,515 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:14,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:14,517 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:14,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,519 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:14,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:14,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:14,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:14,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:14,525 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:14,526 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:14,525 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:14,525 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,526 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:14,526 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:14,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,526 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:14,626 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:14,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:14,634 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:14,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:14,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,636 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:14,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:14,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:14,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:14,637 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,637 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,638 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:14,638 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:14,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:14,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:14,639 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:14,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:14,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,640 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,640 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:14,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:14,640 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:14,640 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:14,640 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:14,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:14,641 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:14,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:14,641 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:14,641 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:15,064 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e12290939f954601bae5f6d2058e71fc to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e12290939f954601bae5f6d2058e71fc 2023-11-10 10:55:15,070 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/8fb017bc8ff447f48f08f444b3da734c 2023-11-10 10:55:15,074 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/8fb017bc8ff447f48f08f444b3da734c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/8fb017bc8ff447f48f08f444b3da734c 2023-11-10 10:55:15,077 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/8fb017bc8ff447f48f08f444b3da734c, entries=1, sequenceid=17, filesize=4.9 K 2023-11-10 10:55:15,078 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 437ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:15,079 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:15,079 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:15,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:15,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:15,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:15,079 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:15,080 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:15,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,080 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:15,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:15,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:15,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53ed3fbc[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:15,082 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:15,082 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,082 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,082 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:15,082 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:15,083 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:15,083 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,083 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:15,083 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:15,083 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,083 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:15,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:15,083 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:15,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:15,085 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:15,086 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:15,086 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:15,086 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,086 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:15,087 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,087 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:15,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,087 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:15,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:15,087 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,088 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:15,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:15,090 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:15,090 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:15,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,090 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:15,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:15,191 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:15,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:15,198 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:15,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:15,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,201 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:15,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:15,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:15,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:15,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,201 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,203 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,203 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:15,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:15,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:15,203 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:15,203 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:15,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:15,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,205 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:15,205 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:15,205 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:15,205 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:15,205 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:15,206 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:15,206 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:15,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:15,206 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:15,206 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:15,618 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122893d73d55f51440bfbee0df914d59f1f5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122893d73d55f51440bfbee0df914d59f1f5 2023-11-10 10:55:16,025 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/a37bf2e7c66940deb11c80a931176538 2023-11-10 10:55:16,034 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/a37bf2e7c66940deb11c80a931176538 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a37bf2e7c66940deb11c80a931176538 2023-11-10 10:55:16,039 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a37bf2e7c66940deb11c80a931176538, entries=1, sequenceid=21, filesize=4.9 K 2023-11-10 10:55:16,040 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 834ms, sequenceid=21, compaction requested=true 2023-11-10 10:55:16,040 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:16,040 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:16,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:16,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:16,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:16,040 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:16,042 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,042 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:16,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:16,043 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,043 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:16,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:16,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:16,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:16,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f3d6872[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:16,045 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:16,045 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,046 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:16,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:16,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:16,047 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,047 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:16,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,048 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:16,048 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:16,048 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:16,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:16,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:16,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:16,051 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:16,051 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:16,051 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:16,051 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,052 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:16,066 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,066 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:16,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,066 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:16,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:16,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:16,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:16,067 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:16,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,070 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:16,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:16,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:16,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:16,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:16,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:16,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,075 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,075 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:16,075 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:16,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:16,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:16,175 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:16,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:16,180 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:16,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:16,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,182 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:16,182 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:16,182 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:16,182 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:16,183 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,183 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,184 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,184 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:16,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:16,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:16,184 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:16,184 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:16,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:16,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:16,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:16,186 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:16,186 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:16,186 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:16,186 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:16,186 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:16,186 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:16,186 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:16,186 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:16,607 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231dda88ac35d87499294080d31e6bea041 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dda88ac35d87499294080d31e6bea041 2023-11-10 10:55:16,652 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:55:17,015 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/b3ddabde713349babcf03d1a4bd3b9ca 2023-11-10 10:55:17,026 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/b3ddabde713349babcf03d1a4bd3b9ca as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b3ddabde713349babcf03d1a4bd3b9ca 2023-11-10 10:55:17,034 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b3ddabde713349babcf03d1a4bd3b9ca, entries=1, sequenceid=25, filesize=4.9 K 2023-11-10 10:55:17,035 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 849ms, sequenceid=25, compaction requested=true 2023-11-10 10:55:17,035 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:17,035 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:17,035 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:17,035 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:17,035 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,035 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:17,035 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:17,037 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,037 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:17,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:17,038 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,038 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:17,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:17,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:17,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:17,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@114041aa[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:17,041 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:17,041 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,043 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,043 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:17,043 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:17,043 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:17,043 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,043 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:17,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:17,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:17,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:17,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:17,049 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:17,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:17,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:17,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,049 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:17,058 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,058 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,058 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:17,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:17,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:17,059 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:17,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:17,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,062 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:17,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,073 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,073 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:17,073 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,074 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:17,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-10 10:55:17,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:17,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:17,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:17,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:17,074 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:17,074 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,075 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,075 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,075 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,075 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:17,075 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:17,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:17,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:17,175 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:17,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:17,184 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:17,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:17,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,187 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:17,187 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:17,188 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:17,188 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:17,189 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,189 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,190 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:17,191 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:17,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:17,192 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:17,192 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:17,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:17,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,194 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,195 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:17,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:17,195 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:17,195 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:17,195 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:17,196 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:17,196 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:17,196 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:17,196 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:17,196 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:17,620 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017e85cc03b50e494a8b8b0528ee0e71d4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017e85cc03b50e494a8b8b0528ee0e71d4 2023-11-10 10:55:18,027 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/6d96b08e5ccc4ac7867371df428d15f6 2023-11-10 10:55:18,038 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/6d96b08e5ccc4ac7867371df428d15f6 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/6d96b08e5ccc4ac7867371df428d15f6 2023-11-10 10:55:18,043 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/6d96b08e5ccc4ac7867371df428d15f6, entries=1, sequenceid=29, filesize=4.9 K 2023-11-10 10:55:18,044 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 848ms, sequenceid=29, compaction requested=true 2023-11-10 10:55:18,044 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:18,044 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:18,045 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:18,045 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:18,045 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,045 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:18,045 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:18,046 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,046 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:18,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:18,047 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,047 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:18,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:18,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:18,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@415037c2[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:18,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:18,049 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,050 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,050 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:18,051 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:18,051 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,051 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:18,051 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:18,052 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:18,052 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,052 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:18,052 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:18,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:18,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:18,055 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:18,055 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:18,055 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:18,055 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,055 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:18,056 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,056 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:18,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,056 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:18,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:18,057 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:18,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,058 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:18,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:18,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:18,061 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:18,061 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,061 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:18,061 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,062 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:18,062 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:18,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-10 10:55:18,062 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:18,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:18,062 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,162 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:18,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:18,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:18,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:18,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,172 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:18,172 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:18,172 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:18,172 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:18,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,173 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,174 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:18,174 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:18,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:18,175 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:18,175 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:18,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:18,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,177 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,177 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:18,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:18,177 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:18,177 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:18,177 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:18,178 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:18,178 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:18,178 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:18,178 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:18,178 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:18,599 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010355365e73b18b4c09980d33eb19d3e826 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010355365e73b18b4c09980d33eb19d3e826 2023-11-10 10:55:19,007 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/d80980c5030d4f55a20d08572c619719 2023-11-10 10:55:19,018 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/d80980c5030d4f55a20d08572c619719 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/d80980c5030d4f55a20d08572c619719 2023-11-10 10:55:19,023 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/d80980c5030d4f55a20d08572c619719, entries=1, sequenceid=33, filesize=4.9 K 2023-11-10 10:55:19,023 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 845ms, sequenceid=33, compaction requested=true 2023-11-10 10:55:19,023 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:19,024 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:19,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:19,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:19,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:19,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:19,025 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,025 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:19,026 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,026 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:19,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:19,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:19,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bfae08b[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:19,029 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:19,029 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,029 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,030 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:19,030 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:19,030 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:19,030 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,030 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:19,031 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,031 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:19,031 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:19,031 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:19,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:19,036 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:19,036 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:19,036 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:19,036 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,036 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:19,038 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,038 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,038 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:19,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:19,039 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,040 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:19,044 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:19,044 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:19,045 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:19,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,045 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,045 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,045 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:19,045 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:19,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:19,145 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:19,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:19,157 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:19,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:19,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,159 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:19,160 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:19,160 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:19,160 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:19,160 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,160 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,162 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:19,162 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:19,162 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:19,162 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:19,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:19,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,164 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:19,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:19,164 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:19,164 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:19,164 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:19,165 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:19,584 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a6d5e5aa87a3484ba7a084b22b985dbb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907a6d5e5aa87a3484ba7a084b22b985dbb 2023-11-10 10:55:19,991 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/96b59faca09e40d581bdfe029e51e0ba 2023-11-10 10:55:20,001 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/96b59faca09e40d581bdfe029e51e0ba as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/96b59faca09e40d581bdfe029e51e0ba 2023-11-10 10:55:20,009 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/96b59faca09e40d581bdfe029e51e0ba, entries=1, sequenceid=37, filesize=4.9 K 2023-11-10 10:55:20,010 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 845ms, sequenceid=37, compaction requested=true 2023-11-10 10:55:20,010 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:20,010 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:20,010 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:20,010 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:20,010 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,010 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:20,010 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:20,012 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,012 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:20,013 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,013 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:20,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:20,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:20,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:20,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f20697e[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:20,016 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:20,016 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,023 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:20,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:20,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:20,024 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,024 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:20,033 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,033 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:20,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:20,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:20,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:20,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:20,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:20,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:20,041 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:20,041 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:20,041 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:20,041 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,041 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:20,043 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:20,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,044 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:20,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:20,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:20,045 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,046 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:20,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,048 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:20,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:20,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:20,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:20,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:20,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:20,048 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:20,148 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:20,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:20,153 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:20,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:20,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,154 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:20,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:20,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-10 10:55:20,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-10 10:55:20,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,155 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,155 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:20,155 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:20,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,156 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-10 10:55:20,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,157 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-10 10:55:20,157 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:20,157 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-10 10:55:20,157 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-10 10:55:20,157 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:20,157 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:20,157 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. started... 2023-11-10 10:55:20,157 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ec4f0712d47624680cc4de9c9ec57bc6 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-10 10:55:20,573 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ebbdaacb905948ab99cc8deec29126ff to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ebbdaacb905948ab99cc8deec29126ff 2023-11-10 10:55:20,980 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/051f601d1b6d406695db3823a5421414 2023-11-10 10:55:20,986 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/051f601d1b6d406695db3823a5421414 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/051f601d1b6d406695db3823a5421414 2023-11-10 10:55:20,992 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/051f601d1b6d406695db3823a5421414, entries=1, sequenceid=41, filesize=4.9 K 2023-11-10 10:55:20,993 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ec4f0712d47624680cc4de9c9ec57bc6 in 836ms, sequenceid=41, compaction requested=true 2023-11-10 10:55:20,994 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:20,994 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:20,994 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-10 10:55:20,994 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-10 10:55:20,994 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,994 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-10 10:55:20,994 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-10 10:55:20,996 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,996 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:20,997 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,997 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:20,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:20,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:20,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-10 10:55:20,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cfe2e21[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:20,999 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-10 10:55:20,999 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:20,999 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-10 10:55:21,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-10 10:55:21,000 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:21,000 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,000 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:21,001 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-10 10:55:21,001 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,001 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:21,001 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-10 10:55:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:21,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:21,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:21,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:21,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-10 10:55:21,005 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-10 10:55:21,005 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:21,005 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:21,005 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,005 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:21,007 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,007 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:21,007 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:21,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:21,008 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:21,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,009 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:21,011 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-10 10:55:21,011 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:21,011 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:21,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:21,011 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,012 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:21,112 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:21,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:21,114 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-10 10:55:21,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:55:21,117 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:55:21,117 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:55:21,117 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614321117 2023-11-10 10:55:21,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-10 10:55:21,120 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-10 10:55:21,120 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:21,122 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x685d6aa9 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:55:21,128 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b8197f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:55:21,128 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:21,553 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ee0f136e7b504134b0ad9c45e36e3c45 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ee0f136e7b504134b0ad9c45e36e3c45 2023-11-10 10:55:21,554 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:21,569 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:55:21,571 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:55:21,577 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:55:21,578 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:55:21,589 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/97f8e35c83744f8387f04db400f65e17 first=Optional[r5] last=Optional[r6] 2023-11-10 10:55:21,589 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/97f8e35c83744f8387f04db400f65e17}] 2023-11-10 10:55:21,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/97f8e35c83744f8387f04db400f65e17 for inclusion in ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-10 10:55:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:55:21,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:21,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/97f8e35c83744f8387f04db400f65e17 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__oth728gsq9r27tu6qnj16e3lbv7rkdjbc730unr6oqfileuke370fs0rnlnkoeu2/family1/97f8e35c83744f8387f04db400f65e17 2023-11-10 10:55:21,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__oth728gsq9r27tu6qnj16e3lbv7rkdjbc730unr6oqfileuke370fs0rnlnkoeu2/family1/97f8e35c83744f8387f04db400f65e17 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_ 2023-11-10 10:55:21,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__oth728gsq9r27tu6qnj16e3lbv7rkdjbc730unr6oqfileuke370fs0rnlnkoeu2/family1/97f8e35c83744f8387f04db400f65e17 into ec4f0712d47624680cc4de9c9ec57bc6/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_ - updating store file list. 2023-11-10 10:55:21,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_ into ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:21,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__oth728gsq9r27tu6qnj16e3lbv7rkdjbc730unr6oqfileuke370fs0rnlnkoeu2/family1/97f8e35c83744f8387f04db400f65e17 into ec4f0712d47624680cc4de9c9ec57bc6/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_) 2023-11-10 10:55:21,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__oth728gsq9r27tu6qnj16e3lbv7rkdjbc730unr6oqfileuke370fs0rnlnkoeu2/family1/97f8e35c83744f8387f04db400f65e17 2023-11-10 10:55:21,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-10 10:55:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-10 10:55:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): ec4f0712d47624680cc4de9c9ec57bc6/family1 is initiating minor compaction 2023-11-10 10:55:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@63c7316e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:55:21,607 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ec4f0712d47624680cc4de9c9ec57bc6/family1 in testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:21,607 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a344e56544d1434ab54336f6dc1a5051, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a848ad9b9d6347ee92c41c28323b73c5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/8fb017bc8ff447f48f08f444b3da734c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a37bf2e7c66940deb11c80a931176538, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b3ddabde713349babcf03d1a4bd3b9ca, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/6d96b08e5ccc4ac7867371df428d15f6, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/d80980c5030d4f55a20d08572c619719, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/96b59faca09e40d581bdfe029e51e0ba, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/051f601d1b6d406695db3823a5421414, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp, totalSize=49.7 K 2023-11-10 10:55:21,607 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting a344e56544d1434ab54336f6dc1a5051, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-10 10:55:21,607 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting a848ad9b9d6347ee92c41c28323b73c5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-10 10:55:21,607 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting 8fb017bc8ff447f48f08f444b3da734c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-10 10:55:21,607 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting a37bf2e7c66940deb11c80a931176538, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-10 10:55:21,608 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting b3ddabde713349babcf03d1a4bd3b9ca, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-10 10:55:21,608 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting 6d96b08e5ccc4ac7867371df428d15f6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-10 10:55:21,608 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting d80980c5030d4f55a20d08572c619719, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-10 10:55:21,608 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting 96b59faca09e40d581bdfe029e51e0ba, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-10 10:55:21,608 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting 051f601d1b6d406695db3823a5421414, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-10 10:55:21,608 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] compactions.Compactor(207): Compacting 2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-10 10:55:21,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:21,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:21,611 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017e85cc03b50e494a8b8b0528ee0e71d4 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017e85cc03b50e494a8b8b0528ee0e71d4 2023-11-10 10:55:21,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010355365e73b18b4c09980d33eb19d3e826 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010355365e73b18b4c09980d33eb19d3e826 2023-11-10 10:55:21,612 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-10 10:55:21,612 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-10 10:55:21,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:21,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:21,634 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] throttle.PressureAwareThroughputController(145): ec4f0712d47624680cc4de9c9ec57bc6#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-10 10:55:22,457 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b6544c00b931414ea9f262403c600d3f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231b6544c00b931414ea9f262403c600d3f 2023-11-10 10:55:22,458 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/c3eec82d277646cd8df32bd37ab01b6b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/c3eec82d277646cd8df32bd37ab01b6b 2023-11-10 10:55:22,460 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:22,464 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ec4f0712d47624680cc4de9c9ec57bc6/family1 of ec4f0712d47624680cc4de9c9ec57bc6 into c3eec82d277646cd8df32bd37ab01b6b(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:22,464 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:22,464 INFO [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699613721607; duration=0sec 2023-11-10 10:55:22,465 DEBUG [RS:0;jenkins-hbase20:43721-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:55:22,481 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c8c03eb0b93e426882ee99b65c99e258 first=Optional[r1] last=Optional[r4] 2023-11-10 10:55:22,482 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c8c03eb0b93e426882ee99b65c99e258}] 2023-11-10 10:55:22,484 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c8c03eb0b93e426882ee99b65c99e258 for inclusion in ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:22,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-10 10:55:22,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:55:22,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:22,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c8c03eb0b93e426882ee99b65c99e258 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vs8ppa4vb0u73v7b2l3s6mg69j1aqhs5l36t857tjhslspcm814vqhvgvbgf6j2q/family1/c8c03eb0b93e426882ee99b65c99e258 2023-11-10 10:55:22,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vs8ppa4vb0u73v7b2l3s6mg69j1aqhs5l36t857tjhslspcm814vqhvgvbgf6j2q/family1/c8c03eb0b93e426882ee99b65c99e258 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_ 2023-11-10 10:55:22,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vs8ppa4vb0u73v7b2l3s6mg69j1aqhs5l36t857tjhslspcm814vqhvgvbgf6j2q/family1/c8c03eb0b93e426882ee99b65c99e258 into ec4f0712d47624680cc4de9c9ec57bc6/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_ - updating store file list. 2023-11-10 10:55:22,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a344e56544d1434ab54336f6dc1a5051, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a848ad9b9d6347ee92c41c28323b73c5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/8fb017bc8ff447f48f08f444b3da734c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a37bf2e7c66940deb11c80a931176538, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b3ddabde713349babcf03d1a4bd3b9ca, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/6d96b08e5ccc4ac7867371df428d15f6, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/d80980c5030d4f55a20d08572c619719, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/96b59faca09e40d581bdfe029e51e0ba, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/051f601d1b6d406695db3823a5421414, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_] to archive 2023-11-10 10:55:22,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:22,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a344e56544d1434ab54336f6dc1a5051 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a344e56544d1434ab54336f6dc1a5051 2023-11-10 10:55:22,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_ into ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:22,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vs8ppa4vb0u73v7b2l3s6mg69j1aqhs5l36t857tjhslspcm814vqhvgvbgf6j2q/family1/c8c03eb0b93e426882ee99b65c99e258 into ec4f0712d47624680cc4de9c9ec57bc6/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_) 2023-11-10 10:55:22,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vs8ppa4vb0u73v7b2l3s6mg69j1aqhs5l36t857tjhslspcm814vqhvgvbgf6j2q/family1/c8c03eb0b93e426882ee99b65c99e258 2023-11-10 10:55:22,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a848ad9b9d6347ee92c41c28323b73c5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a848ad9b9d6347ee92c41c28323b73c5 2023-11-10 10:55:22,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-10 10:55:22,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-10 10:55:22,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(1912): ec4f0712d47624680cc4de9c9ec57bc6/family1 is initiating minor compaction (all files) 2023-11-10 10:55:22,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4e7baf21; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:55:22,496 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ec4f0712d47624680cc4de9c9ec57bc6/family1 in testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:22,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/8fb017bc8ff447f48f08f444b3da734c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/8fb017bc8ff447f48f08f444b3da734c 2023-11-10 10:55:22,496 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b2481f24f41f4b18968082f96251e0c5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/c3eec82d277646cd8df32bd37ab01b6b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp, totalSize=178.1 K 2023-11-10 10:55:22,497 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting b2481f24f41f4b18968082f96251e0c5, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878854600 2023-11-10 10:55:22,497 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting c3eec82d277646cd8df32bd37ab01b6b, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621254600 2023-11-10 10:55:22,497 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] compactions.Compactor(207): Compacting b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965254600 2023-11-10 10:55:22,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a37bf2e7c66940deb11c80a931176538 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/a37bf2e7c66940deb11c80a931176538 2023-11-10 10:55:22,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:22,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b3ddabde713349babcf03d1a4bd3b9ca to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b3ddabde713349babcf03d1a4bd3b9ca 2023-11-10 10:55:22,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:22,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/6d96b08e5ccc4ac7867371df428d15f6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/6d96b08e5ccc4ac7867371df428d15f6 2023-11-10 10:55:22,501 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120117f1bba357d5457ba8debf8e2ca00c61 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120117f1bba357d5457ba8debf8e2ca00c61 2023-11-10 10:55:22,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/d80980c5030d4f55a20d08572c619719 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/d80980c5030d4f55a20d08572c619719 2023-11-10 10:55:22,503 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e12290939f954601bae5f6d2058e71fc to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e12290939f954601bae5f6d2058e71fc 2023-11-10 10:55:22,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/96b59faca09e40d581bdfe029e51e0ba to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/96b59faca09e40d581bdfe029e51e0ba 2023-11-10 10:55:22,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/051f601d1b6d406695db3823a5421414 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/051f601d1b6d406695db3823a5421414 2023-11-10 10:55:22,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122893d73d55f51440bfbee0df914d59f1f5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122893d73d55f51440bfbee0df914d59f1f5 2023-11-10 10:55:22,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/2f8bf00d880c4b2bbada8eb62ab13445_SeqId_44_ 2023-11-10 10:55:22,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dda88ac35d87499294080d31e6bea041 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231dda88ac35d87499294080d31e6bea041 2023-11-10 10:55:22,507 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-10 10:55:22,507 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-10 10:55:22,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:22,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:22,518 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] throttle.PressureAwareThroughputController(145): ec4f0712d47624680cc4de9c9ec57bc6#family1#compaction#167 average throughput is 12.97 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-10 10:55:22,935 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/.tmp/family1/389f2de7acb746099236bf5bce5ded4a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/389f2de7acb746099236bf5bce5ded4a 2023-11-10 10:55:22,944 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ec4f0712d47624680cc4de9c9ec57bc6/family1 of ec4f0712d47624680cc4de9c9ec57bc6 into 389f2de7acb746099236bf5bce5ded4a(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:22,944 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:22,945 INFO [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699613722496; duration=0sec 2023-11-10 10:55:22,945 DEBUG [RS:0;jenkins-hbase20:43721-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-10 10:55:22,945 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e6bbb9ccd2174c87b7358f20391db05e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130e6bbb9ccd2174c87b7358f20391db05e 2023-11-10 10:55:22,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:22,971 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6a8b8a0cac8548638d4bf4b66bb15d45 first=Optional[r00] last=Optional[r8] 2023-11-10 10:55:22,972 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6a8b8a0cac8548638d4bf4b66bb15d45}] 2023-11-10 10:55:22,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6a8b8a0cac8548638d4bf4b66bb15d45 for inclusion in ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:22,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-10 10:55:22,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last= 2023-11-10 10:55:22,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:22,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6a8b8a0cac8548638d4bf4b66bb15d45 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ot97ird7eeus3ubal57eqp2dmt6ukebad5e67oauanmvitelurp31i9trp7706k2/family1/6a8b8a0cac8548638d4bf4b66bb15d45 2023-11-10 10:55:22,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ot97ird7eeus3ubal57eqp2dmt6ukebad5e67oauanmvitelurp31i9trp7706k2/family1/6a8b8a0cac8548638d4bf4b66bb15d45 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/1c83e29a74ba40fab43b84bff8841918_SeqId_50_ 2023-11-10 10:55:22,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ot97ird7eeus3ubal57eqp2dmt6ukebad5e67oauanmvitelurp31i9trp7706k2/family1/6a8b8a0cac8548638d4bf4b66bb15d45 into ec4f0712d47624680cc4de9c9ec57bc6/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/1c83e29a74ba40fab43b84bff8841918_SeqId_50_ - updating store file list. 2023-11-10 10:55:22,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b2481f24f41f4b18968082f96251e0c5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/c3eec82d277646cd8df32bd37ab01b6b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_] to archive 2023-11-10 10:55:22,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:22,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/1c83e29a74ba40fab43b84bff8841918_SeqId_50_ into ec4f0712d47624680cc4de9c9ec57bc6/family1 2023-11-10 10:55:22,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ot97ird7eeus3ubal57eqp2dmt6ukebad5e67oauanmvitelurp31i9trp7706k2/family1/6a8b8a0cac8548638d4bf4b66bb15d45 into ec4f0712d47624680cc4de9c9ec57bc6/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/1c83e29a74ba40fab43b84bff8841918_SeqId_50_) 2023-11-10 10:55:22,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__ot97ird7eeus3ubal57eqp2dmt6ukebad5e67oauanmvitelurp31i9trp7706k2/family1/6a8b8a0cac8548638d4bf4b66bb15d45 2023-11-10 10:55:22,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b2481f24f41f4b18968082f96251e0c5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b2481f24f41f4b18968082f96251e0c5 2023-11-10 10:55:22,983 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:22,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/c3eec82d277646cd8df32bd37ab01b6b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/c3eec82d277646cd8df32bd37ab01b6b 2023-11-10 10:55:22,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:22,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_ to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/family1/b21f0afe5dc84d988a5055fbf34ac333_SeqId_47_ 2023-11-10 10:55:22,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ebbdaacb905948ab99cc8deec29126ff to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ebbdaacb905948ab99cc8deec29126ff 2023-11-10 10:55:22,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288988f455040e4811a66eb04a3a8af716 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511288988f455040e4811a66eb04a3a8af716 2023-11-10 10:55:22,987 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113023c4961cdf2f4d64a92ce4d020ca7b2e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113023c4961cdf2f4d64a92ce4d020ca7b2e 2023-11-10 10:55:22,987 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-10 10:55:22,987 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-10 10:55:22,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:22,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:22,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-10 10:55:22,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-10 10:55:22,988 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:55:22,990 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-10 10:55:22,991 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.8750 sec 2023-11-10 10:55:23,165 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254 (was 252) - Thread LEAK? -, OpenFileDescriptor=666 (was 659) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=79 (was 93), ProcessCount=166 (was 166), AvailableMemoryMB=8300 (was 8315) 2023-11-10 10:55:23,176 INFO [Listener at localhost/37195] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=253, OpenFileDescriptor=666, MaxFileDescriptor=60000, SystemLoadAverage=79, ProcessCount=166, AvailableMemoryMB=8300 2023-11-10 10:55:23,198 DEBUG [Listener at localhost/37195] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-10 10:55:23,256 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10)\xF0\xE9^\xE5\x8E\x86\xBBX\x93\xF7\xA5FTl\xA0"\x10\x86\xB2I\xE2\xB2H\xFA<\xF7\x8CI\xEE\x8Ef\xAF\xA4*\x10\x09mL\xE9\x0B\x8D\xF6\x01\xBF\x90\xFE\xFFj\xB4\x80\xE82\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-10 10:55:23,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-10 10:55:23,259 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-10 10:55:23,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-10 10:55:23,260 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-10 10:55:23,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-10 10:55:23,261 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:23,261 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:23,261 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:23,262 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f empty. 2023-11-10 10:55:23,262 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c empty. 2023-11-10 10:55:23,262 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622 empty. 2023-11-10 10:55:23,262 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:23,262 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:23,262 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:23,262 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-10 10:55:23,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-10 10:55:23,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-10 10:55:23,671 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-10 10:55:23,674 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d338451f0007d7a8e512c0f083ca68f, NAME => 'testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10)\xF0\xE9^\xE5\x8E\x86\xBBX\x93\xF7\xA5FTl\xA0"\x10\x86\xB2I\xE2\xB2H\xFA<\xF7\x8CI\xEE\x8Ef\xAF\xA4*\x10\x09mL\xE9\x0B\x8D\xF6\x01\xBF\x90\xFE\xFFj\xB4\x80\xE82\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:55:23,675 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => c8a7650406ae58672325fe6e37260622, NAME => 'testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10)\xF0\xE9^\xE5\x8E\x86\xBBX\x93\xF7\xA5FTl\xA0"\x10\x86\xB2I\xE2\xB2H\xFA<\xF7\x8CI\xEE\x8Ef\xAF\xA4*\x10\x09mL\xE9\x0B\x8D\xF6\x01\xBF\x90\xFE\xFFj\xB4\x80\xE82\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:55:23,675 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6aa3ae93521f99f0a922eb8df9af868c, NAME => 'testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10)\xF0\xE9^\xE5\x8E\x86\xBBX\x93\xF7\xA5FTl\xA0"\x10\x86\xB2I\xE2\xB2H\xFA<\xF7\x8CI\xEE\x8Ef\xAF\xA4*\x10\x09mL\xE9\x0B\x8D\xF6\x01\xBF\x90\xFE\xFFj\xB4\x80\xE82\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/.tmp 2023-11-10 10:55:23,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-10 10:55:24,087 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:24,087 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing c8a7650406ae58672325fe6e37260622, disabling compactions & flushes 2023-11-10 10:55:24,087 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:24,087 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:24,088 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 6aa3ae93521f99f0a922eb8df9af868c, disabling compactions & flushes 2023-11-10 10:55:24,088 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,088 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,088 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 5d338451f0007d7a8e512c0f083ca68f, disabling compactions & flushes 2023-11-10 10:55:24,089 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,089 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,089 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. after waiting 0 ms 2023-11-10 10:55:24,089 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,089 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,089 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. after waiting 0 ms 2023-11-10 10:55:24,090 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,090 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,090 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:24,090 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,090 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. after waiting 0 ms 2023-11-10 10:55:24,090 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,090 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,090 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,091 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:24,090 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:24,093 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-10 10:55:24,094 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699613724094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613724094"}]},"ts":"1699613724094"} 2023-11-10 10:55:24,095 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613724094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613724094"}]},"ts":"1699613724094"} 2023-11-10 10:55:24,095 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613724094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699613724094"}]},"ts":"1699613724094"} 2023-11-10 10:55:24,097 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-10 10:55:24,098 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-10 10:55:24,098 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613724098"}]},"ts":"1699613724098"} 2023-11-10 10:55:24,099 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-10 10:55:24,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d338451f0007d7a8e512c0f083ca68f, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6aa3ae93521f99f0a922eb8df9af868c, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c8a7650406ae58672325fe6e37260622, ASSIGN}] 2023-11-10 10:55:24,103 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6aa3ae93521f99f0a922eb8df9af868c, ASSIGN 2023-11-10 10:55:24,103 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c8a7650406ae58672325fe6e37260622, ASSIGN 2023-11-10 10:55:24,103 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d338451f0007d7a8e512c0f083ca68f, ASSIGN 2023-11-10 10:55:24,103 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6aa3ae93521f99f0a922eb8df9af868c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:55:24,103 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c8a7650406ae58672325fe6e37260622, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:55:24,103 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d338451f0007d7a8e512c0f083ca68f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43721,1699613570510; forceNewPlan=false, retain=false 2023-11-10 10:55:24,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c8a7650406ae58672325fe6e37260622, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=6aa3ae93521f99f0a922eb8df9af868c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613724257"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613724257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613724257"}]},"ts":"1699613724257"} 2023-11-10 10:55:24,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=5d338451f0007d7a8e512c0f083ca68f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699613724257"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613724257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613724257"}]},"ts":"1699613724257"} 2023-11-10 10:55:24,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613724257"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699613724257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699613724257"}]},"ts":"1699613724257"} 2023-11-10 10:55:24,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure c8a7650406ae58672325fe6e37260622, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:55:24,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 6aa3ae93521f99f0a922eb8df9af868c, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:55:24,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 5d338451f0007d7a8e512c0f083ca68f, server=jenkins-hbase20.apache.org,43721,1699613570510}] 2023-11-10 10:55:24,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-10 10:55:24,414 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6aa3ae93521f99f0a922eb8df9af868c, NAME => 'testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.', STARTKEY => '1', ENDKEY => '2'} 2023-11-10 10:55:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,443 INFO [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,445 DEBUG [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1 2023-11-10 10:55:24,445 DEBUG [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1 2023-11-10 10:55:24,445 INFO [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aa3ae93521f99f0a922eb8df9af868c columnFamilyName family1 2023-11-10 10:55:24,446 INFO [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] regionserver.HStore(310): Store=6aa3ae93521f99f0a922eb8df9af868c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:24,447 INFO [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,448 DEBUG [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2 2023-11-10 10:55:24,448 DEBUG [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2 2023-11-10 10:55:24,448 INFO [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aa3ae93521f99f0a922eb8df9af868c columnFamilyName family2 2023-11-10 10:55:24,449 INFO [StoreOpener-6aa3ae93521f99f0a922eb8df9af868c-1] regionserver.HStore(310): Store=6aa3ae93521f99f0a922eb8df9af868c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:24,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:55:24,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:24,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:55:24,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6aa3ae93521f99f0a922eb8df9af868c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70220001, jitterRate=0.046359553933143616}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:55:24,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:24,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c., pid=121, masterSystemTime=1699613724413 2023-11-10 10:55:24,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:24,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d338451f0007d7a8e512c0f083ca68f, NAME => 'testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.', STARTKEY => '', ENDKEY => '1'} 2023-11-10 10:55:24,456 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=6aa3ae93521f99f0a922eb8df9af868c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,456 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699613724456"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613724456"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613724456"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613724456"}]},"ts":"1699613724456"} 2023-11-10 10:55:24,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:24,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=118 2023-11-10 10:55:24,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 6aa3ae93521f99f0a922eb8df9af868c, server=jenkins-hbase20.apache.org,43721,1699613570510 in 195 msec 2023-11-10 10:55:24,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=6aa3ae93521f99f0a922eb8df9af868c, ASSIGN in 358 msec 2023-11-10 10:55:24,479 INFO [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,480 DEBUG [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1 2023-11-10 10:55:24,480 DEBUG [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1 2023-11-10 10:55:24,481 INFO [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d338451f0007d7a8e512c0f083ca68f columnFamilyName family1 2023-11-10 10:55:24,481 INFO [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] regionserver.HStore(310): Store=5d338451f0007d7a8e512c0f083ca68f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:24,482 INFO [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,483 DEBUG [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2 2023-11-10 10:55:24,483 DEBUG [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2 2023-11-10 10:55:24,483 INFO [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d338451f0007d7a8e512c0f083ca68f columnFamilyName family2 2023-11-10 10:55:24,484 INFO [StoreOpener-5d338451f0007d7a8e512c0f083ca68f-1] regionserver.HStore(310): Store=5d338451f0007d7a8e512c0f083ca68f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:24,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:55:24,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:24,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:55:24,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5d338451f0007d7a8e512c0f083ca68f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61265677, jitterRate=-0.0870702713727951}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:55:24,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:24,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f., pid=122, masterSystemTime=1699613724413 2023-11-10 10:55:24,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:24,490 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c8a7650406ae58672325fe6e37260622, NAME => 'testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.', STARTKEY => '2', ENDKEY => ''} 2023-11-10 10:55:24,490 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=5d338451f0007d7a8e512c0f083ca68f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,490 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613724490"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613724490"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613724490"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613724490"}]},"ts":"1699613724490"} 2023-11-10 10:55:24,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-10 10:55:24,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=117 2023-11-10 10:55:24,492 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 5d338451f0007d7a8e512c0f083ca68f, server=jenkins-hbase20.apache.org,43721,1699613570510 in 228 msec 2023-11-10 10:55:24,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5d338451f0007d7a8e512c0f083ca68f, ASSIGN in 391 msec 2023-11-10 10:55:24,511 INFO [StoreOpener-c8a7650406ae58672325fe6e37260622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,512 DEBUG [StoreOpener-c8a7650406ae58672325fe6e37260622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1 2023-11-10 10:55:24,512 DEBUG [StoreOpener-c8a7650406ae58672325fe6e37260622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1 2023-11-10 10:55:24,512 INFO [StoreOpener-c8a7650406ae58672325fe6e37260622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8a7650406ae58672325fe6e37260622 columnFamilyName family1 2023-11-10 10:55:24,513 INFO [StoreOpener-c8a7650406ae58672325fe6e37260622-1] regionserver.HStore(310): Store=c8a7650406ae58672325fe6e37260622/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:24,513 INFO [StoreOpener-c8a7650406ae58672325fe6e37260622-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,514 DEBUG [StoreOpener-c8a7650406ae58672325fe6e37260622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2 2023-11-10 10:55:24,514 DEBUG [StoreOpener-c8a7650406ae58672325fe6e37260622-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2 2023-11-10 10:55:24,515 INFO [StoreOpener-c8a7650406ae58672325fe6e37260622-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c8a7650406ae58672325fe6e37260622 columnFamilyName family2 2023-11-10 10:55:24,515 INFO [StoreOpener-c8a7650406ae58672325fe6e37260622-1] regionserver.HStore(310): Store=c8a7650406ae58672325fe6e37260622/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-10 10:55:24,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-10 10:55:24,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:24,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-10 10:55:24,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c8a7650406ae58672325fe6e37260622; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72221423, jitterRate=0.07618306577205658}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-10 10:55:24,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:24,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622., pid=120, masterSystemTime=1699613724413 2023-11-10 10:55:24,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,521 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:24,522 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=c8a7650406ae58672325fe6e37260622, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:24,522 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699613724522"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699613724522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699613724522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699613724522"}]},"ts":"1699613724522"} 2023-11-10 10:55:24,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=119 2023-11-10 10:55:24,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure c8a7650406ae58672325fe6e37260622, server=jenkins-hbase20.apache.org,43721,1699613570510 in 262 msec 2023-11-10 10:55:24,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=119, resume processing ppid=116 2023-11-10 10:55:24,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=c8a7650406ae58672325fe6e37260622, ASSIGN in 423 msec 2023-11-10 10:55:24,526 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-10 10:55:24,526 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699613724526"}]},"ts":"1699613724526"} 2023-11-10 10:55:24,527 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-10 10:55:24,529 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-10 10:55:24,530 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2730 sec 2023-11-10 10:55:25,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-10 10:55:25,369 INFO [Listener at localhost/37195] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-10 10:55:25,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:25,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:25,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:25,385 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-10 10:55:25,387 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-10 10:55:25,387 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:25,388 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-10 10:55:25,388 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-10 10:55:25,388 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:25,388 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:25,390 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:25,390 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:25,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:25,390 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:25,390 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:25,391 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:25,392 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-10 10:55:25,392 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-10 10:55:25,393 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-10 10:55:25,393 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:25,393 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-10 10:55:25,393 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:25,393 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. started... 2023-11-10 10:55:25,393 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:55:25,393 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:25,393 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:25,393 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:25,394 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. started... 2023-11-10 10:55:25,394 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. started... 2023-11-10 10:55:25,394 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aa3ae93521f99f0a922eb8df9af868c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:55:25,394 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c8a7650406ae58672325fe6e37260622 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:55:25,394 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5d338451f0007d7a8e512c0f083ca68f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-10 10:55:25,840 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110b12f6f2bef6744d2837b15c957012a70 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110b12f6f2bef6744d2837b15c957012a70 2023-11-10 10:55:25,840 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110fd2327eb7b0b46c98d815d382346258e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110fd2327eb7b0b46c98d815d382346258e 2023-11-10 10:55:25,840 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311109d1afd3c32044721b102428f8e1d8eb5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311109d1afd3c32044721b102428f8e1d8eb5 2023-11-10 10:55:26,254 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/30cb5ec79cab4d01b31500ee388387d7 2023-11-10 10:55:26,259 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/89298c79499243358fb0a157b47e3d4f 2023-11-10 10:55:26,259 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/363e4876356740138f5cf3bf858ce150 2023-11-10 10:55:26,293 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110ee3cf5e092474fda9fde159c9a6c31c3 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231110ee3cf5e092474fda9fde159c9a6c31c3 2023-11-10 10:55:26,696 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311105b363c5c07b04aacbeb7935b07d55578 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311105b363c5c07b04aacbeb7935b07d55578 2023-11-10 10:55:26,696 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311107458ba70ee0247bbb7aa666469edf467 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311107458ba70ee0247bbb7aa666469edf467 2023-11-10 10:55:26,697 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/67a0f68c693148449425233a84bd99d7 2023-11-10 10:55:26,703 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/363e4876356740138f5cf3bf858ce150 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/363e4876356740138f5cf3bf858ce150 2023-11-10 10:55:26,725 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/363e4876356740138f5cf3bf858ce150, entries=4, sequenceid=5, filesize=5.5 K 2023-11-10 10:55:26,726 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/67a0f68c693148449425233a84bd99d7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/67a0f68c693148449425233a84bd99d7 2023-11-10 10:55:26,729 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/67a0f68c693148449425233a84bd99d7, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:55:26,730 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 6aa3ae93521f99f0a922eb8df9af868c in 1336ms, sequenceid=5, compaction requested=false 2023-11-10 10:55:26,730 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-10 10:55:26,730 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:26,730 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:26,730 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:27,102 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/004193a4230c4577bd6472248345c89b 2023-11-10 10:55:27,102 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/3b8b5987e8064e0cb706e4578aa06e76 2023-11-10 10:55:27,107 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/30cb5ec79cab4d01b31500ee388387d7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/30cb5ec79cab4d01b31500ee388387d7 2023-11-10 10:55:27,107 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/89298c79499243358fb0a157b47e3d4f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/89298c79499243358fb0a157b47e3d4f 2023-11-10 10:55:27,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/30cb5ec79cab4d01b31500ee388387d7, entries=4, sequenceid=5, filesize=5.5 K 2023-11-10 10:55:27,131 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/004193a4230c4577bd6472248345c89b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/004193a4230c4577bd6472248345c89b 2023-11-10 10:55:27,132 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/89298c79499243358fb0a157b47e3d4f, entries=4, sequenceid=5, filesize=5.5 K 2023-11-10 10:55:27,132 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/3b8b5987e8064e0cb706e4578aa06e76 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/3b8b5987e8064e0cb706e4578aa06e76 2023-11-10 10:55:27,135 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/004193a4230c4577bd6472248345c89b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:55:27,135 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/3b8b5987e8064e0cb706e4578aa06e76, entries=2, sequenceid=5, filesize=5.1 K 2023-11-10 10:55:27,136 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5d338451f0007d7a8e512c0f083ca68f in 1742ms, sequenceid=5, compaction requested=false 2023-11-10 10:55:27,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:27,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:27,136 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c8a7650406ae58672325fe6e37260622 in 1742ms, sequenceid=5, compaction requested=false 2023-11-10 10:55:27,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:27,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:27,137 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:27,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:27,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:27,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-10 10:55:27,137 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-10 10:55:27,138 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,138 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:27,138 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,138 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:27,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:27,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:27,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:27,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-10 10:55:27,139 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c50ee5b[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:27,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-10 10:55:27,139 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,141 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,141 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-10 10:55:27,141 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-10 10:55:27,141 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:27,141 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,141 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:27,142 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-10 10:55:27,142 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,142 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:27,142 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-10 10:55:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:27,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:27,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:27,144 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-10 10:55:27,144 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-10 10:55:27,144 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:27,144 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:27,144 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-10 10:55:27,144 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:27,145 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,145 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,145 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:27,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:27,145 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:27,146 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:27,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:27,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:27,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-10 10:55:27,148 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-10 10:55:27,148 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:27,148 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:27,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:27,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:27,148 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:27,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:27,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:27,248 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:27,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:27,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:27,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:27,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:27,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:27,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:27,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-10 10:55:27,262 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-10 10:55:27,262 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:27,262 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-10 10:55:27,262 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-10 10:55:27,263 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,263 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:27,265 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:27,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:27,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:27,265 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:27,266 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:27,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:27,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:27,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-10 10:55:27,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-10 10:55:27,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-10 10:55:27,267 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-10 10:55:27,267 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:27,267 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-10 10:55:27,267 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:27,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. started... 2023-11-10 10:55:27,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:27,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:55:27,268 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:27,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:27,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. started... 2023-11-10 10:55:27,268 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aa3ae93521f99f0a922eb8df9af868c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:55:27,268 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. started... 2023-11-10 10:55:27,268 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5d338451f0007d7a8e512c0f083ca68f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:55:27,268 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c8a7650406ae58672325fe6e37260622 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-10 10:55:27,724 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110bbe8d63e7f1947c3ac6f777093b6a537 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110bbe8d63e7f1947c3ac6f777093b6a537 2023-11-10 10:55:27,725 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110cb49417affc7436baad96d97bfc164b7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110cb49417affc7436baad96d97bfc164b7 2023-11-10 10:55:27,725 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111028361402c86d41a68b9cf047bb1214f6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111028361402c86d41a68b9cf047bb1214f6 2023-11-10 10:55:28,138 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/77148d92f23f4be1b1c968e6a3fdf300 2023-11-10 10:55:28,139 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/b0f29f6e181b45babf8c725743ca5168 2023-11-10 10:55:28,142 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/024798e09c534aa3a7ba670c5b27e062 2023-11-10 10:55:28,589 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110ed0c4b0f592d4982967aca909eb26643 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231110ed0c4b0f592d4982967aca909eb26643 2023-11-10 10:55:28,589 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110c3b4bbc0203f4f768a679e2aca979b77 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231110c3b4bbc0203f4f768a679e2aca979b77 2023-11-10 10:55:28,594 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/3a0036546beb40a986621b005ec9ab05 2023-11-10 10:55:28,594 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/8eb1a8b43b92401c890fbf5586ecc4d8 2023-11-10 10:55:28,595 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311101f7451ae586142f6a068263dd419845e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311101f7451ae586142f6a068263dd419845e 2023-11-10 10:55:28,598 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/77148d92f23f4be1b1c968e6a3fdf300 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/77148d92f23f4be1b1c968e6a3fdf300 2023-11-10 10:55:28,598 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/024798e09c534aa3a7ba670c5b27e062 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/024798e09c534aa3a7ba670c5b27e062 2023-11-10 10:55:28,600 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/ee49571168994d0d8883914c1c1b5682 2023-11-10 10:55:28,603 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/b0f29f6e181b45babf8c725743ca5168 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/b0f29f6e181b45babf8c725743ca5168 2023-11-10 10:55:28,622 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/b0f29f6e181b45babf8c725743ca5168, entries=4, sequenceid=9, filesize=5.5 K 2023-11-10 10:55:28,623 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/ee49571168994d0d8883914c1c1b5682 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/ee49571168994d0d8883914c1c1b5682 2023-11-10 10:55:28,627 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/ee49571168994d0d8883914c1c1b5682, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:55:28,627 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c8a7650406ae58672325fe6e37260622 in 1359ms, sequenceid=9, compaction requested=false 2023-11-10 10:55:28,627 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:28,627 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:28,627 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:28,629 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/77148d92f23f4be1b1c968e6a3fdf300, entries=4, sequenceid=9, filesize=5.5 K 2023-11-10 10:55:28,629 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/024798e09c534aa3a7ba670c5b27e062, entries=4, sequenceid=9, filesize=5.5 K 2023-11-10 10:55:28,630 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/8eb1a8b43b92401c890fbf5586ecc4d8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8eb1a8b43b92401c890fbf5586ecc4d8 2023-11-10 10:55:28,630 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/3a0036546beb40a986621b005ec9ab05 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/3a0036546beb40a986621b005ec9ab05 2023-11-10 10:55:28,633 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/3a0036546beb40a986621b005ec9ab05, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:55:28,633 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8eb1a8b43b92401c890fbf5586ecc4d8, entries=2, sequenceid=9, filesize=5.1 K 2023-11-10 10:55:28,634 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5d338451f0007d7a8e512c0f083ca68f in 1366ms, sequenceid=9, compaction requested=false 2023-11-10 10:55:28,634 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 6aa3ae93521f99f0a922eb8df9af868c in 1366ms, sequenceid=9, compaction requested=false 2023-11-10 10:55:28,634 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:28,634 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:28,634 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:28,634 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:28,634 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:28,634 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:28,634 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:28,634 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,634 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-10 10:55:28,634 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-10 10:55:28,635 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,635 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:28,635 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,635 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:28,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:28,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-10 10:55:28,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2002a9e2[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:28,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-10 10:55:28,636 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,637 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,637 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-10 10:55:28,637 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-10 10:55:28,637 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,637 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:28,637 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:28,638 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-10 10:55:28,638 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:28,638 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,638 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-10 10:55:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:28,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:28,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:28,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-10 10:55:28,640 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-10 10:55:28,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:28,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:28,640 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-10 10:55:28,640 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:28,641 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,641 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,641 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:28,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:28,641 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:28,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:28,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,643 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:28,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,644 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,644 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,645 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:28,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-10 10:55:28,645 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:28,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:28,645 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:28,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:28,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:28,745 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:28,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:28,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:28,749 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:28,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:28,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-10 10:55:28,751 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-10 10:55:28,751 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:28,751 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-10 10:55:28,751 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-10 10:55:28,752 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,752 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:28,753 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,753 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:28,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:28,753 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:28,753 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:28,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:28,753 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-10 10:55:28,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-10 10:55:28,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-10 10:55:28,754 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-10 10:55:28,754 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:28,754 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-10 10:55:28,754 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:28,754 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. started... 2023-11-10 10:55:28,754 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:55:28,754 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:28,754 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aa3ae93521f99f0a922eb8df9af868c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:55:28,754 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:28,754 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. started... 2023-11-10 10:55:28,754 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:28,754 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5d338451f0007d7a8e512c0f083ca68f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:55:28,754 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. started... 2023-11-10 10:55:28,754 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c8a7650406ae58672325fe6e37260622 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-10 10:55:29,216 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:55:29,216 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x685d6aa9 to 127.0.0.1:62972 2023-11-10 10:55:29,216 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:29,217 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:55:29,217 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3baacf80 to 127.0.0.1:62972 2023-11-10 10:55:29,217 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:29,234 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311104de007aaffb84c288598e5a70d2dcee2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311104de007aaffb84c288598e5a70d2dcee2 2023-11-10 10:55:29,240 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111093425d9ea61b410b88ed36668c14941d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111093425d9ea61b410b88ed36668c14941d 2023-11-10 10:55:29,241 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110b3052ab109b84f6ab5b9b9e7ac89bcdb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110b3052ab109b84f6ab5b9b9e7ac89bcdb 2023-11-10 10:55:29,257 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/882065b30c6543f9be1315ec8d85c0b5 2023-11-10 10:55:29,648 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/e33427e7349640a89669fdc588783c5b 2023-11-10 10:55:29,657 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/dbe5147f8c544dcab66aa11382164110 2023-11-10 10:55:29,688 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311107bda360cebfb4503ae4c2586f0ac004c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311107bda360cebfb4503ae4c2586f0ac004c 2023-11-10 10:55:29,688 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023111020bc0bee3ea540f6acfedbd4efe02b70 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023111020bc0bee3ea540f6acfedbd4efe02b70 2023-11-10 10:55:29,960 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-10 10:55:30,096 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/74ea5007bd494dbe9ff871a64f6f8c2c 2023-11-10 10:55:30,099 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/9eea136d9c3c458e8cf38517def0bf95 2023-11-10 10:55:30,107 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/882065b30c6543f9be1315ec8d85c0b5 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/882065b30c6543f9be1315ec8d85c0b5 2023-11-10 10:55:30,107 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111096929548ccfa4e8c97eab53be087c7ed to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023111096929548ccfa4e8c97eab53be087c7ed 2023-11-10 10:55:30,108 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/e33427e7349640a89669fdc588783c5b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/e33427e7349640a89669fdc588783c5b 2023-11-10 10:55:30,114 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/06ea594a09274e83a40ac32108efed55 2023-11-10 10:55:30,117 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/dbe5147f8c544dcab66aa11382164110 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/dbe5147f8c544dcab66aa11382164110 2023-11-10 10:55:30,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/e33427e7349640a89669fdc588783c5b, entries=4, sequenceid=13, filesize=5.5 K 2023-11-10 10:55:30,132 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/9eea136d9c3c458e8cf38517def0bf95 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/9eea136d9c3c458e8cf38517def0bf95 2023-11-10 10:55:30,132 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/882065b30c6543f9be1315ec8d85c0b5, entries=4, sequenceid=13, filesize=5.5 K 2023-11-10 10:55:30,133 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/74ea5007bd494dbe9ff871a64f6f8c2c as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/74ea5007bd494dbe9ff871a64f6f8c2c 2023-11-10 10:55:30,135 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/9eea136d9c3c458e8cf38517def0bf95, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:55:30,136 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/74ea5007bd494dbe9ff871a64f6f8c2c, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:55:30,136 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5d338451f0007d7a8e512c0f083ca68f in 1382ms, sequenceid=13, compaction requested=true 2023-11-10 10:55:30,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:30,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:30,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:30,136 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c8a7650406ae58672325fe6e37260622 in 1382ms, sequenceid=13, compaction requested=true 2023-11-10 10:55:30,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:30,136 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:30,136 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:30,141 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/dbe5147f8c544dcab66aa11382164110, entries=4, sequenceid=13, filesize=5.5 K 2023-11-10 10:55:30,141 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/06ea594a09274e83a40ac32108efed55 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/06ea594a09274e83a40ac32108efed55 2023-11-10 10:55:30,144 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/06ea594a09274e83a40ac32108efed55, entries=2, sequenceid=13, filesize=5.1 K 2023-11-10 10:55:30,145 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 6aa3ae93521f99f0a922eb8df9af868c in 1391ms, sequenceid=13, compaction requested=true 2023-11-10 10:55:30,145 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:30,145 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:30,145 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:30,145 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:30,145 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,145 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-10 10:55:30,145 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-10 10:55:30,146 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,146 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:30,147 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,147 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-10 10:55:30,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cb54f05[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:30,149 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-10 10:55:30,149 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,149 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,150 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-10 10:55:30,150 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-10 10:55:30,150 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:30,150 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,150 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:30,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-10 10:55:30,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:30,151 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,151 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-10 10:55:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:30,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-10 10:55:30,154 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-10 10:55:30,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:30,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:30,154 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-10 10:55:30,154 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:30,155 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,155 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,155 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:30,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:30,156 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:30,157 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:30,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:30,159 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-10 10:55:30,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-10 10:55:30,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:30,159 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:30,159 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,159 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:30,160 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:30,160 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:30,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:30,260 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:30,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:30,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:30,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:30,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. with WAL disabled. Data may be lost in the event of a crash. 2023-11-10 10:55:30,268 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:30,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:30,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-10 10:55:30,269 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-10 10:55:30,269 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:30,269 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-10 10:55:30,269 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-10 10:55:30,270 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,270 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:30,272 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:30,272 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:30,272 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:30,272 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:30,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:30,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:30,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:30,273 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-10 10:55:30,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-10 10:55:30,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-10 10:55:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-10 10:55:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-10 10:55:30,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:30,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. started... 2023-11-10 10:55:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:55:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:30,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:30,274 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aa3ae93521f99f0a922eb8df9af868c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:55:30,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. started... 2023-11-10 10:55:30,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:30,274 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. started... 2023-11-10 10:55:30,274 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5d338451f0007d7a8e512c0f083ca68f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:55:30,274 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c8a7650406ae58672325fe6e37260622 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-10 10:55:30,717 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023111010ceb7f78fa54d5ea5683119c1a0008d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111010ceb7f78fa54d5ea5683119c1a0008d 2023-11-10 10:55:30,717 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311109d91675dfdc94f31b07a29d0256c6683 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311109d91675dfdc94f31b07a29d0256c6683 2023-11-10 10:55:30,720 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023111017bdf2778cd4482ea02fc2c4ff8157bf to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111017bdf2778cd4482ea02fc2c4ff8157bf 2023-11-10 10:55:31,131 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/891c95c3a47e47afa0f7ebff494d0f88 2023-11-10 10:55:31,133 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/2a6bbdb8941547f8a7596b3234da85a1 2023-11-10 10:55:31,133 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/c8587798c52d4dff9c14f8b17e000bc0 2023-11-10 10:55:31,162 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311105e36fa254b2c41b1800c1ab7acbf4fe5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311105e36fa254b2c41b1800c1ab7acbf4fe5 2023-11-10 10:55:31,170 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311101f692f0736954c78b1eb89dee2e74dfd to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311101f692f0736954c78b1eb89dee2e74dfd 2023-11-10 10:55:31,567 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/166a8b7207174486a2d1a0a93a278b20 2023-11-10 10:55:31,574 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/596cb735ab7744dcb433fe88f6c981f9 2023-11-10 10:55:31,575 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110530840fcc5404253a0c4714129edb9d5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231110530840fcc5404253a0c4714129edb9d5 2023-11-10 10:55:31,576 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/891c95c3a47e47afa0f7ebff494d0f88 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/891c95c3a47e47afa0f7ebff494d0f88 2023-11-10 10:55:31,580 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/c8587798c52d4dff9c14f8b17e000bc0 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/c8587798c52d4dff9c14f8b17e000bc0 2023-11-10 10:55:31,607 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/c8587798c52d4dff9c14f8b17e000bc0, entries=4, sequenceid=17, filesize=5.5 K 2023-11-10 10:55:31,607 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/596cb735ab7744dcb433fe88f6c981f9 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/596cb735ab7744dcb433fe88f6c981f9 2023-11-10 10:55:31,607 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/891c95c3a47e47afa0f7ebff494d0f88, entries=4, sequenceid=17, filesize=5.5 K 2023-11-10 10:55:31,608 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/166a8b7207174486a2d1a0a93a278b20 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/166a8b7207174486a2d1a0a93a278b20 2023-11-10 10:55:31,611 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/596cb735ab7744dcb433fe88f6c981f9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:55:31,611 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/166a8b7207174486a2d1a0a93a278b20, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:55:31,612 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c8a7650406ae58672325fe6e37260622 in 1338ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:31,612 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 6aa3ae93521f99f0a922eb8df9af868c in 1338ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:31,612 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:31,612 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:31,612 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:31,612 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:31,612 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:31,612 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:31,984 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/8de6b3604c2e485a855f31c901f6470d 2023-11-10 10:55:31,993 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/2a6bbdb8941547f8a7596b3234da85a1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/2a6bbdb8941547f8a7596b3234da85a1 2023-11-10 10:55:32,016 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/2a6bbdb8941547f8a7596b3234da85a1, entries=4, sequenceid=17, filesize=5.5 K 2023-11-10 10:55:32,017 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/8de6b3604c2e485a855f31c901f6470d as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/8de6b3604c2e485a855f31c901f6470d 2023-11-10 10:55:32,021 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/8de6b3604c2e485a855f31c901f6470d, entries=2, sequenceid=17, filesize=5.1 K 2023-11-10 10:55:32,022 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5d338451f0007d7a8e512c0f083ca68f in 1748ms, sequenceid=17, compaction requested=true 2023-11-10 10:55:32,022 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:32,022 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:32,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:32,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:32,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-10 10:55:32,022 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-10 10:55:32,023 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,023 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:32,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:32,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,024 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:32,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-10 10:55:32,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4187e994[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:32,025 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-10 10:55:32,025 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,026 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,026 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-10 10:55:32,026 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-10 10:55:32,026 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:32,026 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,026 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:32,026 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,026 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:32,027 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:32,027 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:32,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:32,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-10 10:55:32,028 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-10 10:55:32,028 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:32,028 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:32,028 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-10 10:55:32,028 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:32,029 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,029 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:32,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,029 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:32,030 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:32,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,031 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:32,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:32,032 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:32,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-10 10:55:32,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:32,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:32,033 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:32,032 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:32,033 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,133 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:32,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:32,145 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:32,152 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:32,160 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:32,161 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:32,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-10 10:55:32,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-10 10:55:32,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-10 10:55:32,240 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-10 10:55:32,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:32,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-10 10:55:32,240 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-10 10:55:32,241 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,241 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:32,241 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:32,241 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:32,242 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:32,242 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-10 10:55:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:32,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-10 10:55:32,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:32,242 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-10 10:55:32,243 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-10 10:55:32,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-10 10:55:32,243 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-10 10:55:32,243 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-10 10:55:32,243 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-10 10:55:32,243 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:32,243 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:32,243 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. started... 2023-11-10 10:55:32,243 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:32,243 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. started... 2023-11-10 10:55:32,243 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-10 10:55:32,243 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-10 10:55:32,243 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 5d338451f0007d7a8e512c0f083ca68f 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:55:32,243 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. started... 2023-11-10 10:55:32,243 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 6aa3ae93521f99f0a922eb8df9af868c 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:55:32,243 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c8a7650406ae58672325fe6e37260622 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-10 10:55:32,680 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/3f658134432c4b7a8bd6e83741457efb 2023-11-10 10:55:32,700 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f658134432c4b7a8bd6e83741457efb 2023-11-10 10:55:33,086 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/a4dbffbf9ac046c3930f51df3934671b 2023-11-10 10:55:33,086 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/fada589f33b544c88545d1fc3655202f 2023-11-10 10:55:33,116 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4dbffbf9ac046c3930f51df3934671b 2023-11-10 10:55:33,123 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fada589f33b544c88545d1fc3655202f 2023-11-10 10:55:33,517 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/0c38a64e6ad743c7aaf2bc00c64430be 2023-11-10 10:55:33,526 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c38a64e6ad743c7aaf2bc00c64430be 2023-11-10 10:55:33,527 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/3f658134432c4b7a8bd6e83741457efb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/3f658134432c4b7a8bd6e83741457efb 2023-11-10 10:55:33,533 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/8572428d751a4b82bc0d0ae3b322b290 2023-11-10 10:55:33,536 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8572428d751a4b82bc0d0ae3b322b290 2023-11-10 10:55:33,537 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/fada589f33b544c88545d1fc3655202f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/fada589f33b544c88545d1fc3655202f 2023-11-10 10:55:33,551 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f658134432c4b7a8bd6e83741457efb 2023-11-10 10:55:33,551 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/3f658134432c4b7a8bd6e83741457efb, entries=3, sequenceid=23, filesize=5.2 K 2023-11-10 10:55:33,552 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/0c38a64e6ad743c7aaf2bc00c64430be as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/0c38a64e6ad743c7aaf2bc00c64430be 2023-11-10 10:55:33,556 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c38a64e6ad743c7aaf2bc00c64430be 2023-11-10 10:55:33,556 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/0c38a64e6ad743c7aaf2bc00c64430be, entries=1, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:33,556 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5d338451f0007d7a8e512c0f083ca68f in 1313ms, sequenceid=23, compaction requested=true 2023-11-10 10:55:33,556 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:33,556 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:33,556 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-10 10:55:33,558 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fada589f33b544c88545d1fc3655202f 2023-11-10 10:55:33,558 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/fada589f33b544c88545d1fc3655202f, entries=3, sequenceid=23, filesize=5.2 K 2023-11-10 10:55:33,558 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/8572428d751a4b82bc0d0ae3b322b290 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8572428d751a4b82bc0d0ae3b322b290 2023-11-10 10:55:33,562 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8572428d751a4b82bc0d0ae3b322b290 2023-11-10 10:55:33,562 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8572428d751a4b82bc0d0ae3b322b290, entries=1, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:33,563 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 6aa3ae93521f99f0a922eb8df9af868c in 1320ms, sequenceid=23, compaction requested=true 2023-11-10 10:55:33,563 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:33,563 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:33,563 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-10 10:55:33,930 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/b929aa3cf6b241758ba58bc05c835562 2023-11-10 10:55:33,937 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b929aa3cf6b241758ba58bc05c835562 2023-11-10 10:55:33,938 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/a4dbffbf9ac046c3930f51df3934671b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/a4dbffbf9ac046c3930f51df3934671b 2023-11-10 10:55:33,962 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4dbffbf9ac046c3930f51df3934671b 2023-11-10 10:55:33,962 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/a4dbffbf9ac046c3930f51df3934671b, entries=3, sequenceid=23, filesize=5.2 K 2023-11-10 10:55:33,963 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/b929aa3cf6b241758ba58bc05c835562 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/b929aa3cf6b241758ba58bc05c835562 2023-11-10 10:55:33,967 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b929aa3cf6b241758ba58bc05c835562 2023-11-10 10:55:33,967 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/b929aa3cf6b241758ba58bc05c835562, entries=1, sequenceid=23, filesize=5.0 K 2023-11-10 10:55:33,967 INFO [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c8a7650406ae58672325fe6e37260622 in 1724ms, sequenceid=23, compaction requested=true 2023-11-10 10:55:33,967 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:33,967 DEBUG [rs(jenkins-hbase20.apache.org,43721,1699613570510)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:33,968 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-10 10:55:33,968 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-10 10:55:33,968 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,968 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-10 10:55:33,968 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-10 10:55:33,969 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,969 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:33,969 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,969 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-10 10:55:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:33,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43721,1699613570510' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-10 10:55:33,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a2ee5c9[Count = 0] remaining members to acquire global barrier 2023-11-10 10:55:33,970 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-10 10:55:33,971 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,971 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,971 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-10 10:55:33,972 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-10 10:55:33,972 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43721,1699613570510' in zk 2023-11-10 10:55:33,972 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,972 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-10 10:55:33,973 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,973 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-10 10:55:33,973 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:33,973 DEBUG [member: 'jenkins-hbase20.apache.org,43721,1699613570510' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-10 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:33,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:33,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43721,1699613570510': 2023-11-10 10:55:33,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43721,1699613570510' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-10 10:55:33,975 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-10 10:55:33,975 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-10 10:55:33,975 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-10 10:55:33,975 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-10 10:55:33,975 INFO [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-10 10:55:33,976 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,976 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-10 10:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-10 10:55:33,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,976 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-10 10:55:33,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:33,977 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,977 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-10 10:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-10 10:55:33,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:33,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-10 10:55:33,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-10 10:55:33,979 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-10 10:55:33,989 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-10 10:55:33,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-10 10:55:33,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-10 10:55:33,989 DEBUG [(jenkins-hbase20.apache.org,35827,1699613569566)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-10 10:55:33,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-10 10:55:33,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-10 10:55:33,989 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-10 10:55:33,989 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-10 10:55:34,090 DEBUG [Listener at localhost/37195] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-10 10:55:34,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35827] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-10 10:55:34,091 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:34,092 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 6aa3ae93521f99f0a922eb8df9af868c/family1 is initiating major compaction (all files) 2023-11-10 10:55:34,092 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:34,092 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:34,092 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 6aa3ae93521f99f0a922eb8df9af868c/family1 in testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:34,093 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/363e4876356740138f5cf3bf858ce150, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/77148d92f23f4be1b1c968e6a3fdf300, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/dbe5147f8c544dcab66aa11382164110, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/c8587798c52d4dff9c14f8b17e000bc0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/fada589f33b544c88545d1fc3655202f] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp, totalSize=27.1 K 2023-11-10 10:55:34,094 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 363e4876356740138f5cf3bf858ce150, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613725381 2023-11-10 10:55:34,094 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 77148d92f23f4be1b1c968e6a3fdf300, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613727253 2023-11-10 10:55:34,095 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting dbe5147f8c544dcab66aa11382164110, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613728747 2023-11-10 10:55:34,096 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting c8587798c52d4dff9c14f8b17e000bc0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613730265 2023-11-10 10:55:34,097 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting fada589f33b544c88545d1fc3655202f, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:34,110 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 6aa3ae93521f99f0a922eb8df9af868c#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:34,556 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del 2023-11-10 10:55:34,556 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del 2023-11-10 10:55:35,417 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90de40e0e1cf40328505f3960ae697eb 2023-11-10 10:55:35,418 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family1/90de40e0e1cf40328505f3960ae697eb as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/90de40e0e1cf40328505f3960ae697eb 2023-11-10 10:55:35,435 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 90de40e0e1cf40328505f3960ae697eb 2023-11-10 10:55:35,436 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6aa3ae93521f99f0a922eb8df9af868c/family1 of 6aa3ae93521f99f0a922eb8df9af868c into 90de40e0e1cf40328505f3960ae697eb(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:55:35,436 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:35,436 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:35,436 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 6aa3ae93521f99f0a922eb8df9af868c/family2 is initiating major compaction (all files) 2023-11-10 10:55:35,437 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:35,437 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:35,437 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 6aa3ae93521f99f0a922eb8df9af868c/family2 in testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:35,437 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/67a0f68c693148449425233a84bd99d7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8eb1a8b43b92401c890fbf5586ecc4d8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/06ea594a09274e83a40ac32108efed55, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/596cb735ab7744dcb433fe88f6c981f9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8572428d751a4b82bc0d0ae3b322b290] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp, totalSize=25.4 K 2023-11-10 10:55:35,437 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 67a0f68c693148449425233a84bd99d7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613725381 2023-11-10 10:55:35,438 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 8eb1a8b43b92401c890fbf5586ecc4d8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613727253 2023-11-10 10:55:35,438 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 06ea594a09274e83a40ac32108efed55, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613728747 2023-11-10 10:55:35,439 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 596cb735ab7744dcb433fe88f6c981f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613730265 2023-11-10 10:55:35,439 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 8572428d751a4b82bc0d0ae3b322b290, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:35,446 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 6aa3ae93521f99f0a922eb8df9af868c#family2#compaction#199 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:35,481 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/363e4876356740138f5cf3bf858ce150, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/77148d92f23f4be1b1c968e6a3fdf300, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/dbe5147f8c544dcab66aa11382164110, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/c8587798c52d4dff9c14f8b17e000bc0, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/fada589f33b544c88545d1fc3655202f] to archive 2023-11-10 10:55:35,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:35,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/363e4876356740138f5cf3bf858ce150 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/363e4876356740138f5cf3bf858ce150 2023-11-10 10:55:35,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/77148d92f23f4be1b1c968e6a3fdf300 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/77148d92f23f4be1b1c968e6a3fdf300 2023-11-10 10:55:35,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/dbe5147f8c544dcab66aa11382164110 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/dbe5147f8c544dcab66aa11382164110 2023-11-10 10:55:35,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/c8587798c52d4dff9c14f8b17e000bc0 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/c8587798c52d4dff9c14f8b17e000bc0 2023-11-10 10:55:35,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/fada589f33b544c88545d1fc3655202f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/fada589f33b544c88545d1fc3655202f 2023-11-10 10:55:35,859 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311100defd86977724c39b3e539680e036c84_del 2023-11-10 10:55:35,860 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311100defd86977724c39b3e539680e036c84_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311100defd86977724c39b3e539680e036c84_del 2023-11-10 10:55:36,275 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08652f09542949318e770e0de5d9ba5f 2023-11-10 10:55:36,276 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/.tmp/family2/08652f09542949318e770e0de5d9ba5f as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/08652f09542949318e770e0de5d9ba5f 2023-11-10 10:55:36,282 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 08652f09542949318e770e0de5d9ba5f 2023-11-10 10:55:36,283 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 6aa3ae93521f99f0a922eb8df9af868c/family2 of 6aa3ae93521f99f0a922eb8df9af868c into 08652f09542949318e770e0de5d9ba5f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:36,283 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:36,283 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:36,283 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 5d338451f0007d7a8e512c0f083ca68f/family1 is initiating major compaction (all files) 2023-11-10 10:55:36,284 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:36,284 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:36,284 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 5d338451f0007d7a8e512c0f083ca68f/family1 in testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:36,284 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/30cb5ec79cab4d01b31500ee388387d7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/024798e09c534aa3a7ba670c5b27e062, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/e33427e7349640a89669fdc588783c5b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/2a6bbdb8941547f8a7596b3234da85a1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/3f658134432c4b7a8bd6e83741457efb] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp, totalSize=27.1 K 2023-11-10 10:55:36,285 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 30cb5ec79cab4d01b31500ee388387d7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613725380 2023-11-10 10:55:36,285 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 024798e09c534aa3a7ba670c5b27e062, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613727253 2023-11-10 10:55:36,286 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting e33427e7349640a89669fdc588783c5b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613728747 2023-11-10 10:55:36,287 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 2a6bbdb8941547f8a7596b3234da85a1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613730264 2023-11-10 10:55:36,287 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 3f658134432c4b7a8bd6e83741457efb, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:36,300 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 5d338451f0007d7a8e512c0f083ca68f#family1#compaction#200 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:36,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/67a0f68c693148449425233a84bd99d7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8eb1a8b43b92401c890fbf5586ecc4d8, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/06ea594a09274e83a40ac32108efed55, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/596cb735ab7744dcb433fe88f6c981f9, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8572428d751a4b82bc0d0ae3b322b290] to archive 2023-11-10 10:55:36,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:36,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/67a0f68c693148449425233a84bd99d7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/67a0f68c693148449425233a84bd99d7 2023-11-10 10:55:36,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8eb1a8b43b92401c890fbf5586ecc4d8 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8eb1a8b43b92401c890fbf5586ecc4d8 2023-11-10 10:55:36,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/06ea594a09274e83a40ac32108efed55 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/06ea594a09274e83a40ac32108efed55 2023-11-10 10:55:36,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/596cb735ab7744dcb433fe88f6c981f9 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/596cb735ab7744dcb433fe88f6c981f9 2023-11-10 10:55:36,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8572428d751a4b82bc0d0ae3b322b290 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family2/8572428d751a4b82bc0d0ae3b322b290 2023-11-10 10:55:36,741 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del 2023-11-10 10:55:36,741 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del 2023-11-10 10:55:37,603 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64f7d88455f843a28e39706be09c9c74 2023-11-10 10:55:37,604 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family1/64f7d88455f843a28e39706be09c9c74 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/64f7d88455f843a28e39706be09c9c74 2023-11-10 10:55:37,623 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64f7d88455f843a28e39706be09c9c74 2023-11-10 10:55:37,624 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5d338451f0007d7a8e512c0f083ca68f/family1 of 5d338451f0007d7a8e512c0f083ca68f into 64f7d88455f843a28e39706be09c9c74(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:55:37,624 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:37,625 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:37,625 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): 5d338451f0007d7a8e512c0f083ca68f/family2 is initiating major compaction (all files) 2023-11-10 10:55:37,625 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:37,625 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:37,625 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of 5d338451f0007d7a8e512c0f083ca68f/family2 in testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:37,625 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/004193a4230c4577bd6472248345c89b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/3a0036546beb40a986621b005ec9ab05, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/9eea136d9c3c458e8cf38517def0bf95, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/8de6b3604c2e485a855f31c901f6470d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/0c38a64e6ad743c7aaf2bc00c64430be] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp, totalSize=25.4 K 2023-11-10 10:55:37,626 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 004193a4230c4577bd6472248345c89b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613725380 2023-11-10 10:55:37,626 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 3a0036546beb40a986621b005ec9ab05, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613727253 2023-11-10 10:55:37,626 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 9eea136d9c3c458e8cf38517def0bf95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613728747 2023-11-10 10:55:37,627 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 8de6b3604c2e485a855f31c901f6470d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613730264 2023-11-10 10:55:37,627 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 0c38a64e6ad743c7aaf2bc00c64430be, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:37,634 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): 5d338451f0007d7a8e512c0f083ca68f#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:37,680 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/30cb5ec79cab4d01b31500ee388387d7, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/024798e09c534aa3a7ba670c5b27e062, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/e33427e7349640a89669fdc588783c5b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/2a6bbdb8941547f8a7596b3234da85a1, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/3f658134432c4b7a8bd6e83741457efb] to archive 2023-11-10 10:55:37,681 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:37,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/30cb5ec79cab4d01b31500ee388387d7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/30cb5ec79cab4d01b31500ee388387d7 2023-11-10 10:55:37,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/024798e09c534aa3a7ba670c5b27e062 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/024798e09c534aa3a7ba670c5b27e062 2023-11-10 10:55:37,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/e33427e7349640a89669fdc588783c5b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/e33427e7349640a89669fdc588783c5b 2023-11-10 10:55:37,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/2a6bbdb8941547f8a7596b3234da85a1 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/2a6bbdb8941547f8a7596b3234da85a1 2023-11-10 10:55:37,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/3f658134432c4b7a8bd6e83741457efb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/3f658134432c4b7a8bd6e83741457efb 2023-11-10 10:55:38,050 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231110f95f17181bad488a845b3df8244571cb_del 2023-11-10 10:55:38,050 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231110f95f17181bad488a845b3df8244571cb_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231110f95f17181bad488a845b3df8244571cb_del 2023-11-10 10:55:38,868 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4ba95524a95482da1336286cdc4f147 2023-11-10 10:55:38,869 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/.tmp/family2/e4ba95524a95482da1336286cdc4f147 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/e4ba95524a95482da1336286cdc4f147 2023-11-10 10:55:38,872 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4ba95524a95482da1336286cdc4f147 2023-11-10 10:55:38,873 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5d338451f0007d7a8e512c0f083ca68f/family2 of 5d338451f0007d7a8e512c0f083ca68f into e4ba95524a95482da1336286cdc4f147(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:55:38,873 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:38,873 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:38,873 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): c8a7650406ae58672325fe6e37260622/family1 is initiating major compaction (all files) 2023-11-10 10:55:38,873 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:38,874 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:38,874 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of c8a7650406ae58672325fe6e37260622/family1 in testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:38,874 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/89298c79499243358fb0a157b47e3d4f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/b0f29f6e181b45babf8c725743ca5168, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/882065b30c6543f9be1315ec8d85c0b5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/891c95c3a47e47afa0f7ebff494d0f88, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/a4dbffbf9ac046c3930f51df3934671b] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp, totalSize=27.1 K 2023-11-10 10:55:38,875 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 89298c79499243358fb0a157b47e3d4f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613725382 2023-11-10 10:55:38,875 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting b0f29f6e181b45babf8c725743ca5168, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613727254 2023-11-10 10:55:38,876 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 882065b30c6543f9be1315ec8d85c0b5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613728747 2023-11-10 10:55:38,876 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 891c95c3a47e47afa0f7ebff494d0f88, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613730265 2023-11-10 10:55:38,876 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting a4dbffbf9ac046c3930f51df3934671b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:38,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/004193a4230c4577bd6472248345c89b, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/3a0036546beb40a986621b005ec9ab05, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/9eea136d9c3c458e8cf38517def0bf95, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/8de6b3604c2e485a855f31c901f6470d, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/0c38a64e6ad743c7aaf2bc00c64430be] to archive 2023-11-10 10:55:38,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:38,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/004193a4230c4577bd6472248345c89b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/004193a4230c4577bd6472248345c89b 2023-11-10 10:55:38,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/3a0036546beb40a986621b005ec9ab05 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/3a0036546beb40a986621b005ec9ab05 2023-11-10 10:55:38,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/9eea136d9c3c458e8cf38517def0bf95 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/9eea136d9c3c458e8cf38517def0bf95 2023-11-10 10:55:38,884 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): c8a7650406ae58672325fe6e37260622#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:38,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/8de6b3604c2e485a855f31c901f6470d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/8de6b3604c2e485a855f31c901f6470d 2023-11-10 10:55:38,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/0c38a64e6ad743c7aaf2bc00c64430be to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family2/0c38a64e6ad743c7aaf2bc00c64430be 2023-11-10 10:55:39,327 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del 2023-11-10 10:55:39,327 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del 2023-11-10 10:55:39,770 DEBUG [regionserver/jenkins-hbase20:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-10 10:55:40,189 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c46f5c80c9894fc4afbe2e9c6e0455a7 2023-11-10 10:55:40,190 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family1/c46f5c80c9894fc4afbe2e9c6e0455a7 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/c46f5c80c9894fc4afbe2e9c6e0455a7 2023-11-10 10:55:40,209 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c46f5c80c9894fc4afbe2e9c6e0455a7 2023-11-10 10:55:40,210 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c8a7650406ae58672325fe6e37260622/family1 of c8a7650406ae58672325fe6e37260622 into c46f5c80c9894fc4afbe2e9c6e0455a7(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-10 10:55:40,210 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:40,210 DEBUG [Listener at localhost/37195] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-10 10:55:40,210 DEBUG [Listener at localhost/37195] regionserver.HStore(1912): c8a7650406ae58672325fe6e37260622/family2 is initiating major compaction (all files) 2023-11-10 10:55:40,210 INFO [Listener at localhost/37195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-10 10:55:40,210 INFO [Listener at localhost/37195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-10 10:55:40,212 INFO [Listener at localhost/37195] regionserver.HRegion(2259): Starting compaction of c8a7650406ae58672325fe6e37260622/family2 in testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:40,212 INFO [Listener at localhost/37195] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/3b8b5987e8064e0cb706e4578aa06e76, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/ee49571168994d0d8883914c1c1b5682, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/74ea5007bd494dbe9ff871a64f6f8c2c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/166a8b7207174486a2d1a0a93a278b20, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/b929aa3cf6b241758ba58bc05c835562] into tmpdir=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp, totalSize=25.4 K 2023-11-10 10:55:40,212 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 3b8b5987e8064e0cb706e4578aa06e76, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699613725382 2023-11-10 10:55:40,213 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting ee49571168994d0d8883914c1c1b5682, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699613727254 2023-11-10 10:55:40,213 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 74ea5007bd494dbe9ff871a64f6f8c2c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699613728747 2023-11-10 10:55:40,213 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting 166a8b7207174486a2d1a0a93a278b20, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699613730265 2023-11-10 10:55:40,214 DEBUG [Listener at localhost/37195] compactions.Compactor(207): Compacting b929aa3cf6b241758ba58bc05c835562, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-10 10:55:40,220 INFO [Listener at localhost/37195] throttle.PressureAwareThroughputController(145): c8a7650406ae58672325fe6e37260622#family2#compaction#203 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-10 10:55:40,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/89298c79499243358fb0a157b47e3d4f, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/b0f29f6e181b45babf8c725743ca5168, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/882065b30c6543f9be1315ec8d85c0b5, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/891c95c3a47e47afa0f7ebff494d0f88, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/a4dbffbf9ac046c3930f51df3934671b] to archive 2023-11-10 10:55:40,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:40,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/89298c79499243358fb0a157b47e3d4f to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/89298c79499243358fb0a157b47e3d4f 2023-11-10 10:55:40,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/b0f29f6e181b45babf8c725743ca5168 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/b0f29f6e181b45babf8c725743ca5168 2023-11-10 10:55:40,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/882065b30c6543f9be1315ec8d85c0b5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/882065b30c6543f9be1315ec8d85c0b5 2023-11-10 10:55:40,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/891c95c3a47e47afa0f7ebff494d0f88 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/891c95c3a47e47afa0f7ebff494d0f88 2023-11-10 10:55:40,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/a4dbffbf9ac046c3930f51df3934671b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/a4dbffbf9ac046c3930f51df3934671b 2023-11-10 10:55:40,634 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311107d0269d7354048d2a8da2c34814dcc44_del 2023-11-10 10:55:40,635 INFO [Listener at localhost/37195] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311107d0269d7354048d2a8da2c34814dcc44_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311107d0269d7354048d2a8da2c34814dcc44_del 2023-11-10 10:55:41,060 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5b10098b6a34ac882874e9406b0003a 2023-11-10 10:55:41,062 DEBUG [Listener at localhost/37195] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/.tmp/family2/c5b10098b6a34ac882874e9406b0003a as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/c5b10098b6a34ac882874e9406b0003a 2023-11-10 10:55:41,067 INFO [Listener at localhost/37195] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5b10098b6a34ac882874e9406b0003a 2023-11-10 10:55:41,068 INFO [Listener at localhost/37195] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c8a7650406ae58672325fe6e37260622/family2 of c8a7650406ae58672325fe6e37260622 into c5b10098b6a34ac882874e9406b0003a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-10 10:55:41,068 DEBUG [Listener at localhost/37195] regionserver.HRegion(2289): Compaction status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:41,072 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:41,074 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:41,077 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:41,078 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:41,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/3b8b5987e8064e0cb706e4578aa06e76, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/ee49571168994d0d8883914c1c1b5682, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/74ea5007bd494dbe9ff871a64f6f8c2c, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/166a8b7207174486a2d1a0a93a278b20, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/b929aa3cf6b241758ba58bc05c835562] to archive 2023-11-10 10:55:41,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:41,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/3b8b5987e8064e0cb706e4578aa06e76 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/3b8b5987e8064e0cb706e4578aa06e76 2023-11-10 10:55:41,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/ee49571168994d0d8883914c1c1b5682 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/ee49571168994d0d8883914c1c1b5682 2023-11-10 10:55:41,083 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35827] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10)\xF0\xE9^\xE5\x8E\x86\xBBX\x93\xF7\xA5FTl\xA0"\x10\x86\xB2I\xE2\xB2H\xFA<\xF7\x8CI\xEE\x8Ef\xAF\xA4*\x10\x09mL\xE9\x0B\x8D\xF6\x01\xBF\x90\xFE\xFFj\xB4\x80\xE82\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-10 10:55:41,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/74ea5007bd494dbe9ff871a64f6f8c2c to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/74ea5007bd494dbe9ff871a64f6f8c2c 2023-11-10 10:55:41,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/166a8b7207174486a2d1a0a93a278b20 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/166a8b7207174486a2d1a0a93a278b20 2023-11-10 10:55:41,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/b929aa3cf6b241758ba58bc05c835562 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family2/b929aa3cf6b241758ba58bc05c835562 2023-11-10 10:55:41,101 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-10 10:55:41,101 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-10 10:55:41,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:55:41,102 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699614341102 2023-11-10 10:55:41,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-10 10:55:41,364 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-10 10:55:41,382 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del 2023-11-10 10:55:41,404 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del 2023-11-10 10:55:41,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del 2023-11-10 10:55:41,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:41,423 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] zookeeper.ReadOnlyZKClient(139): Connect 0x0ade0aa9 to 127.0.0.1:62972 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-10 10:55:41,427 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f10dbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-10 10:55:41,427 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231110 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:42,373 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231110c9852a7acf7646fca3eee3576b6742c2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110c9852a7acf7646fca3eee3576b6742c2 2023-11-10 10:55:42,374 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:42,384 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-10 10:55:42,386 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-10 10:55:42,394 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-10 10:55:42,396 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38406, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-10 10:55:42,424 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231110/family1/bdea2ef3ae26461b94092ddbfb301205 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-10 10:55:42,425 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231110/family1/bdea2ef3ae26461b94092ddbfb301205}] 2023-11-10 10:55:42,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231110/family1/bdea2ef3ae26461b94092ddbfb301205 for inclusion in c8a7650406ae58672325fe6e37260622/family1 2023-11-10 10:55:42,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-10 10:55:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-10 10:55:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:42,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231110/family1/bdea2ef3ae26461b94092ddbfb301205 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__jp9tmtubk73oltfq20t2n2qe7bmq7blo4l7pav7ro72j66m7sfl7b61vbf38ik8c/family1/bdea2ef3ae26461b94092ddbfb301205 2023-11-10 10:55:42,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__jp9tmtubk73oltfq20t2n2qe7bmq7blo4l7pav7ro72j66m7sfl7b61vbf38ik8c/family1/bdea2ef3ae26461b94092ddbfb301205 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/88982698753d4e488ca24f231546620e_SeqId_28_ 2023-11-10 10:55:42,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__jp9tmtubk73oltfq20t2n2qe7bmq7blo4l7pav7ro72j66m7sfl7b61vbf38ik8c/family1/bdea2ef3ae26461b94092ddbfb301205 into c8a7650406ae58672325fe6e37260622/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/88982698753d4e488ca24f231546620e_SeqId_28_ - updating store file list. 2023-11-10 10:55:42,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/88982698753d4e488ca24f231546620e_SeqId_28_ into c8a7650406ae58672325fe6e37260622/family1 2023-11-10 10:55:42,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__jp9tmtubk73oltfq20t2n2qe7bmq7blo4l7pav7ro72j66m7sfl7b61vbf38ik8c/family1/bdea2ef3ae26461b94092ddbfb301205 into c8a7650406ae58672325fe6e37260622/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/family1/88982698753d4e488ca24f231546620e_SeqId_28_) 2023-11-10 10:55:42,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__jp9tmtubk73oltfq20t2n2qe7bmq7blo4l7pav7ro72j66m7sfl7b61vbf38ik8c/family1/bdea2ef3ae26461b94092ddbfb301205 2023-11-10 10:55:42,476 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231110 table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:42,476 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:42,478 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111028361402c86d41a68b9cf047bb1214f6 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111028361402c86d41a68b9cf047bb1214f6 2023-11-10 10:55:42,479 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111093425d9ea61b410b88ed36668c14941d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023111093425d9ea61b410b88ed36668c14941d 2023-11-10 10:55:42,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311109d91675dfdc94f31b07a29d0256c6683 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311109d91675dfdc94f31b07a29d0256c6683 2023-11-10 10:55:42,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110fd2327eb7b0b46c98d815d382346258e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110fd2327eb7b0b46c98d815d382346258e 2023-11-10 10:55:42,480 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-10 10:55:42,480 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231110' 2023-11-10 10:55:42,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231110 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:42,481 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231110 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:43,414 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231110909b567cfc34447187165f4a1755d415 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110909b567cfc34447187165f4a1755d415 2023-11-10 10:55:43,414 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:43,451 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231110/family1/0c71ef5a69f94de49e27c5406ad51c59 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-10 10:55:43,452 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231110/family1/0c71ef5a69f94de49e27c5406ad51c59}] 2023-11-10 10:55:43,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231110/family1/0c71ef5a69f94de49e27c5406ad51c59 for inclusion in 6aa3ae93521f99f0a922eb8df9af868c/family1 2023-11-10 10:55:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-10 10:55:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-10 10:55:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:43,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231110/family1/0c71ef5a69f94de49e27c5406ad51c59 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__c5074b754nvvhqp74ipalclo79qkrjcgqqmbengkhh2jkvp6jjla2b53fqdegp7l/family1/0c71ef5a69f94de49e27c5406ad51c59 2023-11-10 10:55:43,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__c5074b754nvvhqp74ipalclo79qkrjcgqqmbengkhh2jkvp6jjla2b53fqdegp7l/family1/0c71ef5a69f94de49e27c5406ad51c59 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/5f7bfe7f55824c3cb771cdff8b9ad4dd_SeqId_28_ 2023-11-10 10:55:43,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__c5074b754nvvhqp74ipalclo79qkrjcgqqmbengkhh2jkvp6jjla2b53fqdegp7l/family1/0c71ef5a69f94de49e27c5406ad51c59 into 6aa3ae93521f99f0a922eb8df9af868c/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/5f7bfe7f55824c3cb771cdff8b9ad4dd_SeqId_28_ - updating store file list. 2023-11-10 10:55:43,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/5f7bfe7f55824c3cb771cdff8b9ad4dd_SeqId_28_ into 6aa3ae93521f99f0a922eb8df9af868c/family1 2023-11-10 10:55:43,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__c5074b754nvvhqp74ipalclo79qkrjcgqqmbengkhh2jkvp6jjla2b53fqdegp7l/family1/0c71ef5a69f94de49e27c5406ad51c59 into 6aa3ae93521f99f0a922eb8df9af868c/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/family1/5f7bfe7f55824c3cb771cdff8b9ad4dd_SeqId_28_) 2023-11-10 10:55:43,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__c5074b754nvvhqp74ipalclo79qkrjcgqqmbengkhh2jkvp6jjla2b53fqdegp7l/family1/0c71ef5a69f94de49e27c5406ad51c59 2023-11-10 10:55:43,494 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231110 table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:43,495 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:43,496 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111017bdf2778cd4482ea02fc2c4ff8157bf to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023111017bdf2778cd4482ea02fc2c4ff8157bf 2023-11-10 10:55:43,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311109d1afd3c32044721b102428f8e1d8eb5 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311109d1afd3c32044721b102428f8e1d8eb5 2023-11-10 10:55:43,498 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110b3052ab109b84f6ab5b9b9e7ac89bcdb to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110b3052ab109b84f6ab5b9b9e7ac89bcdb 2023-11-10 10:55:43,499 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110cb49417affc7436baad96d97bfc164b7 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231110cb49417affc7436baad96d97bfc164b7 2023-11-10 10:55:43,499 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-10 10:55:43,499 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231110' 2023-11-10 10:55:43,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231110 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:43,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231110 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:44,032 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311101b84276fc5eb4b108878d74fa6893a8e to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311101b84276fc5eb4b108878d74fa6893a8e 2023-11-10 10:55:44,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:44,067 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231110/family1/1bff04cf117a4ffda416cd4b95b7042b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-10 10:55:44,068 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f., hostname=jenkins-hbase20.apache.org,43721,1699613570510, seqNum=2 for row with hfile group [{family1,hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231110/family1/1bff04cf117a4ffda416cd4b95b7042b}] 2023-11-10 10:55:44,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(763): Validating hfile at hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231110/family1/1bff04cf117a4ffda416cd4b95b7042b for inclusion in 5d338451f0007d7a8e512c0f083ca68f/family1 2023-11-10 10:55:44,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-10 10:55:44,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(777): Region bounds: first= last=1 2023-11-10 10:55:44,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegion(2446): Flush status journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:44,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231110/family1/1bff04cf117a4ffda416cd4b95b7042b to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__pkb7nqi1hkt9h36v65o7igtgtn1qtausvnutilptivv7hrmvqcd1ftv32cvo305k/family1/1bff04cf117a4ffda416cd4b95b7042b 2023-11-10 10:55:44,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__pkb7nqi1hkt9h36v65o7igtgtn1qtausvnutilptivv7hrmvqcd1ftv32cvo305k/family1/1bff04cf117a4ffda416cd4b95b7042b as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/d6b8f5541e8847a58f77c0d4851bbd63_SeqId_28_ 2023-11-10 10:55:44,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(849): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__pkb7nqi1hkt9h36v65o7igtgtn1qtausvnutilptivv7hrmvqcd1ftv32cvo305k/family1/1bff04cf117a4ffda416cd4b95b7042b into 5d338451f0007d7a8e512c0f083ca68f/family1 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/d6b8f5541e8847a58f77c0d4851bbd63_SeqId_28_ - updating store file list. 2023-11-10 10:55:44,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(882): Loaded HFile hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/d6b8f5541e8847a58f77c0d4851bbd63_SeqId_28_ into 5d338451f0007d7a8e512c0f083ca68f/family1 2023-11-10 10:55:44,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.HStore(855): Successfully loaded hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__pkb7nqi1hkt9h36v65o7igtgtn1qtausvnutilptivv7hrmvqcd1ftv32cvo305k/family1/1bff04cf117a4ffda416cd4b95b7042b into 5d338451f0007d7a8e512c0f083ca68f/family1 (new location: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/family1/d6b8f5541e8847a58f77c0d4851bbd63_SeqId_28_) 2023-11-10 10:55:44,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43721] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/staging/jenkins__testMajorCompactionFromAdmin__pkb7nqi1hkt9h36v65o7igtgtn1qtausvnutilptivv7hrmvqcd1ftv32cvo305k/family1/1bff04cf117a4ffda416cd4b95b7042b 2023-11-10 10:55:44,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231110 table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:44,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:44,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111010ceb7f78fa54d5ea5683119c1a0008d to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023111010ceb7f78fa54d5ea5683119c1a0008d 2023-11-10 10:55:44,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311104de007aaffb84c288598e5a70d2dcee2 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311104de007aaffb84c288598e5a70d2dcee2 2023-11-10 10:55:44,114 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110b12f6f2bef6744d2837b15c957012a70 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110b12f6f2bef6744d2837b15c957012a70 2023-11-10 10:55:44,115 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110bbe8d63e7f1947c3ac6f777093b6a537 to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110bbe8d63e7f1947c3ac6f777093b6a537 2023-11-10 10:55:44,115 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-10 10:55:44,115 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231110' 2023-11-10 10:55:44,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231110 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:44,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-10 10:55:44,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-10 10:55:44,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del] 2023-11-10 10:55:44,116 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:44,117 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231110910ea832bfd64ab9a7f8db8e12951901_del 2023-11-10 10:55:44,117 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-10 10:55:44,117 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del] 2023-11-10 10:55:44,117 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:44,118 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311102623445c44b340eab4ae38b272c91c52_del 2023-11-10 10:55:44,118 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-10 10:55:44,118 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] compactions.PartitionedMobCompactor(367): [hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del] 2023-11-10 10:55:44,118 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] backup.HFileArchiver(360): Archiving compacted files. 2023-11-10 10:55:44,119 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del to hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231110122d86a081bb486283a6376b8d013986_del 2023-11-10 10:55:44,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-10 10:55:44,119 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699613574520] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-10 10:55:44,120 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-10 10:55:44,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.0200 sec 2023-11-10 10:55:44,140 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:44,144 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:44,149 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-10 10:55:44,150 DEBUG [Listener at localhost/37195] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-10 10:55:44,155 INFO [Listener at localhost/37195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-10 10:55:44,190 INFO [Listener at localhost/37195] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 253), OpenFileDescriptor=654 (was 666), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=56 (was 79), ProcessCount=166 (was 166), AvailableMemoryMB=8251 (was 8300) 2023-11-10 10:55:44,191 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7248ce28 to 127.0.0.1:62972 2023-11-10 10:55:44,191 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:44,191 INFO [Listener at localhost/37195] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-10 10:55:44,191 INFO [Listener at localhost/37195] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-10 10:55:44,191 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40c66ea7 to 127.0.0.1:62972 2023-11-10 10:55:44,191 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:44,191 DEBUG [Listener at localhost/37195] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-10 10:55:44,192 DEBUG [Listener at localhost/37195] util.JVMClusterUtil(257): Found active master hash=1135608738, stopped=false 2023-11-10 10:55:44,192 INFO [Listener at localhost/37195] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:55:44,192 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-10 10:55:44,192 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-10 10:55:44,192 INFO [Listener at localhost/37195] procedure2.ProcedureExecutor(628): Stopping 2023-11-10 10:55:44,192 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:55:44,193 DEBUG [Listener at localhost/37195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78f64792 to 127.0.0.1:62972 2023-11-10 10:55:44,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-10 10:55:44,193 DEBUG [Listener at localhost/37195] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:44,193 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-10 10:55:44,193 INFO [Listener at localhost/37195] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,43721,1699613570510' ***** 2023-11-10 10:55:44,193 INFO [Listener at localhost/37195] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-10 10:55:44,193 INFO [RS:0;jenkins-hbase20:43721] regionserver.HeapMemoryManager(220): Stopping 2023-11-10 10:55:44,193 INFO [RS:0;jenkins-hbase20:43721] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-10 10:55:44,193 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-10 10:55:44,193 INFO [RS:0;jenkins-hbase20:43721] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-10 10:55:44,193 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 6aa3ae93521f99f0a922eb8df9af868c 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 967b16d4c017fd910dfe7c1d1ea18d86 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 7952c1ffcb36612cf85086c22e3b6bd1 2023-11-10 10:55:44,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6aa3ae93521f99f0a922eb8df9af868c, disabling compactions & flushes 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for f39582ea31193f99288921c66f1414f1 2023-11-10 10:55:44,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for b908cc77579006daf878d3b2dd1b0a7a 2023-11-10 10:55:44,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 620ce06af7c5c692d21991e92530ba9a 2023-11-10 10:55:44,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. after waiting 0 ms 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for d597a48975b7e6b8cc15edc5c51e69d0 2023-11-10 10:55:44,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for cb199996e4f6b2b47673f68e14b3530a 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for aec7f5328d591ab91ad7d6c0448f66ff 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 39aed9de2af4a055694f0d6732d82764 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 3df0b49e0178a4ede9f722a9850f8b65 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 5d2ce2a7600c83ffbc19dedfaf004b7e 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 5d338451f0007d7a8e512c0f083ca68f 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for ec4f0712d47624680cc4de9c9ec57bc6 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 018ecef83024ab82c89a197d629ec7a4 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for c8a7650406ae58672325fe6e37260622 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for b5388fe6b3c513779c89d7cabf105864 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 4eef889b597ecf2d30eb14d14197ee04 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 0cd96916b2d2e727befbf8dce6a73b3b 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:44,194 DEBUG [RS:0;jenkins-hbase20:43721] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x728ee08d to 127.0.0.1:62972 2023-11-10 10:55:44,194 DEBUG [RS:0;jenkins-hbase20:43721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:44,194 INFO [RS:0;jenkins-hbase20:43721] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-10 10:55:44,195 INFO [RS:0;jenkins-hbase20:43721] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-10 10:55:44,195 INFO [RS:0;jenkins-hbase20:43721] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-10 10:55:44,195 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-10 10:55:44,195 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-10 10:55:44,195 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-10 10:55:44,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-10 10:55:44,195 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-10 10:55:44,195 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-10 10:55:44,195 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-10 10:55:44,195 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-11-10 10:55:44,195 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 018ecef83024ab82c89a197d629ec7a4, 0cd96916b2d2e727befbf8dce6a73b3b, 1588230740, 39aed9de2af4a055694f0d6732d82764, 3df0b49e0178a4ede9f722a9850f8b65, 4eef889b597ecf2d30eb14d14197ee04, 5d2ce2a7600c83ffbc19dedfaf004b7e, 5d338451f0007d7a8e512c0f083ca68f, 620ce06af7c5c692d21991e92530ba9a, 6aa3ae93521f99f0a922eb8df9af868c, 7952c1ffcb36612cf85086c22e3b6bd1, 967b16d4c017fd910dfe7c1d1ea18d86, aec7f5328d591ab91ad7d6c0448f66ff, b5388fe6b3c513779c89d7cabf105864, b908cc77579006daf878d3b2dd1b0a7a, c8a7650406ae58672325fe6e37260622, cb199996e4f6b2b47673f68e14b3530a, d597a48975b7e6b8cc15edc5c51e69d0, ec4f0712d47624680cc4de9c9ec57bc6, f39582ea31193f99288921c66f1414f1, fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:55:44,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/6aa3ae93521f99f0a922eb8df9af868c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-10 10:55:44,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:44,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6aa3ae93521f99f0a922eb8df9af868c: 2023-11-10 10:55:44,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699613723219.6aa3ae93521f99f0a922eb8df9af868c. 2023-11-10 10:55:44,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 967b16d4c017fd910dfe7c1d1ea18d86, disabling compactions & flushes 2023-11-10 10:55:44,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:55:44,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:55:44,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. after waiting 0 ms 2023-11-10 10:55:44,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:55:44,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithWeeklyPolicy/967b16d4c017fd910dfe7c1d1ea18d86/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-10 10:55:44,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:55:44,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 967b16d4c017fd910dfe7c1d1ea18d86: 2023-11-10 10:55:44,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699613602440.967b16d4c017fd910dfe7c1d1ea18d86. 2023-11-10 10:55:44,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7952c1ffcb36612cf85086c22e3b6bd1, disabling compactions & flushes 2023-11-10 10:55:44,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:55:44,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:55:44,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. after waiting 0 ms 2023-11-10 10:55:44,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:55:44,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7952c1ffcb36612cf85086c22e3b6bd1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-10 10:55:44,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:55:44,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7952c1ffcb36612cf85086c22e3b6bd1: 2023-11-10 10:55:44,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699613629210.7952c1ffcb36612cf85086c22e3b6bd1. 2023-11-10 10:55:44,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f39582ea31193f99288921c66f1414f1, disabling compactions & flushes 2023-11-10 10:55:44,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:55:44,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:55:44,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. after waiting 0 ms 2023-11-10 10:55:44,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:55:44,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/f39582ea31193f99288921c66f1414f1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-10 10:55:44,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:55:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f39582ea31193f99288921c66f1414f1: 2023-11-10 10:55:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699613667185.f39582ea31193f99288921c66f1414f1. 2023-11-10 10:55:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b908cc77579006daf878d3b2dd1b0a7a, disabling compactions & flushes 2023-11-10 10:55:44,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:55:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:55:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. after waiting 0 ms 2023-11-10 10:55:44,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:55:44,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b908cc77579006daf878d3b2dd1b0a7a/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-10 10:55:44,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:55:44,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b908cc77579006daf878d3b2dd1b0a7a: 2023-11-10 10:55:44,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699613614813.b908cc77579006daf878d3b2dd1b0a7a. 2023-11-10 10:55:44,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 620ce06af7c5c692d21991e92530ba9a, disabling compactions & flushes 2023-11-10 10:55:44,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:55:44,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:55:44,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. after waiting 0 ms 2023-11-10 10:55:44,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:55:44,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyPolicy/620ce06af7c5c692d21991e92530ba9a/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-10 10:55:44,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:55:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 620ce06af7c5c692d21991e92530ba9a: 2023-11-10 10:55:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699613618909.620ce06af7c5c692d21991e92530ba9a. 2023-11-10 10:55:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d597a48975b7e6b8cc15edc5c51e69d0, disabling compactions & flushes 2023-11-10 10:55:44,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:55:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:55:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. after waiting 0 ms 2023-11-10 10:55:44,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:55:44,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/d597a48975b7e6b8cc15edc5c51e69d0/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-10 10:55:44,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:55:44,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d597a48975b7e6b8cc15edc5c51e69d0: 2023-11-10 10:55:44,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699613667185.d597a48975b7e6b8cc15edc5c51e69d0. 2023-11-10 10:55:44,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing cb199996e4f6b2b47673f68e14b3530a, disabling compactions & flushes 2023-11-10 10:55:44,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:55:44,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:55:44,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. after waiting 0 ms 2023-11-10 10:55:44,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:55:44,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/cb199996e4f6b2b47673f68e14b3530a/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-10 10:55:44,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:55:44,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for cb199996e4f6b2b47673f68e14b3530a: 2023-11-10 10:55:44,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699613574663.cb199996e4f6b2b47673f68e14b3530a. 2023-11-10 10:55:44,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aec7f5328d591ab91ad7d6c0448f66ff, disabling compactions & flushes 2023-11-10 10:55:44,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:44,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:44,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. after waiting 0 ms 2023-11-10 10:55:44,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:44,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/aec7f5328d591ab91ad7d6c0448f66ff/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-10 10:55:44,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:44,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aec7f5328d591ab91ad7d6c0448f66ff: 2023-11-10 10:55:44,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699613692133.aec7f5328d591ab91ad7d6c0448f66ff. 2023-11-10 10:55:44,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 39aed9de2af4a055694f0d6732d82764, disabling compactions & flushes 2023-11-10 10:55:44,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:55:44,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:55:44,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. after waiting 0 ms 2023-11-10 10:55:44,233 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:55:44,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testCompactionWithHFileLink/39aed9de2af4a055694f0d6732d82764/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-10 10:55:44,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:55:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 39aed9de2af4a055694f0d6732d82764: 2023-11-10 10:55:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699613667185.39aed9de2af4a055694f0d6732d82764. 2023-11-10 10:55:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3df0b49e0178a4ede9f722a9850f8b65, disabling compactions & flushes 2023-11-10 10:55:44,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. after waiting 0 ms 2023-11-10 10:55:44,237 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:44,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/3df0b49e0178a4ede9f722a9850f8b65/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-10 10:55:44,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:44,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3df0b49e0178a4ede9f722a9850f8b65: 2023-11-10 10:55:44,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699613692133.3df0b49e0178a4ede9f722a9850f8b65. 2023-11-10 10:55:44,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5d2ce2a7600c83ffbc19dedfaf004b7e, disabling compactions & flushes 2023-11-10 10:55:44,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:55:44,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:55:44,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. after waiting 0 ms 2023-11-10 10:55:44,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:55:44,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/5d2ce2a7600c83ffbc19dedfaf004b7e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-10 10:55:44,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:55:44,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5d2ce2a7600c83ffbc19dedfaf004b7e: 2023-11-10 10:55:44,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699613614813.5d2ce2a7600c83ffbc19dedfaf004b7e. 2023-11-10 10:55:44,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5d338451f0007d7a8e512c0f083ca68f, disabling compactions & flushes 2023-11-10 10:55:44,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:44,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:44,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. after waiting 0 ms 2023-11-10 10:55:44,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:44,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/5d338451f0007d7a8e512c0f083ca68f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-10 10:55:44,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:44,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5d338451f0007d7a8e512c0f083ca68f: 2023-11-10 10:55:44,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699613723219.5d338451f0007d7a8e512c0f083ca68f. 2023-11-10 10:55:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ec4f0712d47624680cc4de9c9ec57bc6, disabling compactions & flushes 2023-11-10 10:55:44,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. after waiting 0 ms 2023-11-10 10:55:44,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMinorCompactionWithMonthlyPolicy/ec4f0712d47624680cc4de9c9ec57bc6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-10 10:55:44,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ec4f0712d47624680cc4de9c9ec57bc6: 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699613709954.ec4f0712d47624680cc4de9c9ec57bc6. 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 018ecef83024ab82c89a197d629ec7a4, disabling compactions & flushes 2023-11-10 10:55:44,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. after waiting 0 ms 2023-11-10 10:55:44,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:55:44,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 018ecef83024ab82c89a197d629ec7a4 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-10 10:55:44,274 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-10 10:55:44,279 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-10 10:55:44,396 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 018ecef83024ab82c89a197d629ec7a4, 0cd96916b2d2e727befbf8dce6a73b3b, 1588230740, 4eef889b597ecf2d30eb14d14197ee04, b5388fe6b3c513779c89d7cabf105864, c8a7650406ae58672325fe6e37260622, fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:55:44,596 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 018ecef83024ab82c89a197d629ec7a4, 0cd96916b2d2e727befbf8dce6a73b3b, 1588230740, 4eef889b597ecf2d30eb14d14197ee04, b5388fe6b3c513779c89d7cabf105864, c8a7650406ae58672325fe6e37260622, fe690bcf7d1c51ffd313a540edb9d688 2023-11-10 10:55:44,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/.tmp/info/485b81b6623d470c9c1214ce4eb366f8 2023-11-10 10:55:44,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 485b81b6623d470c9c1214ce4eb366f8 2023-11-10 10:55:44,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/.tmp/info/4787af22070d47e082ecb066fec5d4ba 2023-11-10 10:55:44,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/.tmp/info/4787af22070d47e082ecb066fec5d4ba as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/info/4787af22070d47e082ecb066fec5d4ba 2023-11-10 10:55:44,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/info/4787af22070d47e082ecb066fec5d4ba, entries=3, sequenceid=7, filesize=4.8 K 2023-11-10 10:55:44,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 018ecef83024ab82c89a197d629ec7a4 in 424ms, sequenceid=7, compaction requested=false 2023-11-10 10:55:44,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/namespace/018ecef83024ab82c89a197d629ec7a4/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-10 10:55:44,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:55:44,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 018ecef83024ab82c89a197d629ec7a4: 2023-11-10 10:55:44,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699613572988.018ecef83024ab82c89a197d629ec7a4. 2023-11-10 10:55:44,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c8a7650406ae58672325fe6e37260622, disabling compactions & flushes 2023-11-10 10:55:44,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:44,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:44,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. after waiting 0 ms 2023-11-10 10:55:44,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:44,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionFromAdmin/c8a7650406ae58672325fe6e37260622/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-10 10:55:44,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:44,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c8a7650406ae58672325fe6e37260622: 2023-11-10 10:55:44,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699613723219.c8a7650406ae58672325fe6e37260622. 2023-11-10 10:55:44,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b5388fe6b3c513779c89d7cabf105864, disabling compactions & flushes 2023-11-10 10:55:44,688 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:55:44,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:55:44,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. after waiting 0 ms 2023-11-10 10:55:44,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:55:44,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testScannerOnBulkLoadRefHFiles/b5388fe6b3c513779c89d7cabf105864/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-10 10:55:44,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:55:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b5388fe6b3c513779c89d7cabf105864: 2023-11-10 10:55:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699613614813.b5388fe6b3c513779c89d7cabf105864. 2023-11-10 10:55:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4eef889b597ecf2d30eb14d14197ee04, disabling compactions & flushes 2023-11-10 10:55:44,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:55:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:55:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. after waiting 0 ms 2023-11-10 10:55:44,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:55:44,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithMonthlyPolicy/4eef889b597ecf2d30eb14d14197ee04/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-10 10:55:44,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:55:44,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4eef889b597ecf2d30eb14d14197ee04: 2023-11-10 10:55:44,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699613588485.4eef889b597ecf2d30eb14d14197ee04. 2023-11-10 10:55:44,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fe690bcf7d1c51ffd313a540edb9d688, disabling compactions & flushes 2023-11-10 10:55:44,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:55:44,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:55:44,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. after waiting 0 ms 2023-11-10 10:55:44,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:55:44,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/fe690bcf7d1c51ffd313a540edb9d688/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-10 10:55:44,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:55:44,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fe690bcf7d1c51ffd313a540edb9d688: 2023-11-10 10:55:44,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699613644643.fe690bcf7d1c51ffd313a540edb9d688. 2023-11-10 10:55:44,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0cd96916b2d2e727befbf8dce6a73b3b, disabling compactions & flushes 2023-11-10 10:55:44,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:44,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:44,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. after waiting 0 ms 2023-11-10 10:55:44,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:44,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/ns/testMinorCompaction/0cd96916b2d2e727befbf8dce6a73b3b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-10 10:55:44,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:44,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0cd96916b2d2e727befbf8dce6a73b3b: 2023-11-10 10:55:44,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699613692133.0cd96916b2d2e727befbf8dce6a73b3b. 2023-11-10 10:55:44,797 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-10 10:55:44,997 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-10 10:55:45,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/.tmp/rep_barrier/43d9684842464788a4917204f46a3a24 2023-11-10 10:55:45,025 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43d9684842464788a4917204f46a3a24 2023-11-10 10:55:45,109 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-10 10:55:45,110 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-10 10:55:45,198 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-11-10 10:55:45,198 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-10 10:55:45,198 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-10 10:55:45,399 DEBUG [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-10 10:55:45,433 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/.tmp/table/b757eb147cbd43648604c9a2dcfcb705 2023-11-10 10:55:45,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b757eb147cbd43648604c9a2dcfcb705 2023-11-10 10:55:45,438 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/.tmp/info/485b81b6623d470c9c1214ce4eb366f8 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/info/485b81b6623d470c9c1214ce4eb366f8 2023-11-10 10:55:45,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 485b81b6623d470c9c1214ce4eb366f8 2023-11-10 10:55:45,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/info/485b81b6623d470c9c1214ce4eb366f8, entries=226, sequenceid=130, filesize=37.9 K 2023-11-10 10:55:45,443 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/.tmp/rep_barrier/43d9684842464788a4917204f46a3a24 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/rep_barrier/43d9684842464788a4917204f46a3a24 2023-11-10 10:55:45,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 43d9684842464788a4917204f46a3a24 2023-11-10 10:55:45,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/rep_barrier/43d9684842464788a4917204f46a3a24, entries=1, sequenceid=130, filesize=5.0 K 2023-11-10 10:55:45,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/.tmp/table/b757eb147cbd43648604c9a2dcfcb705 as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/table/b757eb147cbd43648604c9a2dcfcb705 2023-11-10 10:55:45,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b757eb147cbd43648604c9a2dcfcb705 2023-11-10 10:55:45,455 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/table/b757eb147cbd43648604c9a2dcfcb705, entries=27, sequenceid=130, filesize=6.6 K 2023-11-10 10:55:45,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1262ms, sequenceid=130, compaction requested=false 2023-11-10 10:55:45,461 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-10 10:55:45,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-10 10:55:45,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-10 10:55:45,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-10 10:55:45,462 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-10 10:55:45,599 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,43721,1699613570510; all regions closed. 2023-11-10 10:55:45,612 DEBUG [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/oldWALs 2023-11-10 10:55:45,612 INFO [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43721%2C1699613570510.meta:.meta(num 1699613572747) 2023-11-10 10:55:45,617 DEBUG [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/oldWALs 2023-11-10 10:55:45,617 INFO [RS:0;jenkins-hbase20:43721] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43721%2C1699613570510:(num 1699613572225) 2023-11-10 10:55:45,617 DEBUG [RS:0;jenkins-hbase20:43721] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:45,618 INFO [RS:0;jenkins-hbase20:43721] regionserver.LeaseManager(133): Closed leases 2023-11-10 10:55:45,618 INFO [RS:0;jenkins-hbase20:43721] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-10 10:55:45,618 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-10 10:55:45,619 INFO [RS:0;jenkins-hbase20:43721] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43721 2023-11-10 10:55:45,628 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-10 10:55:45,628 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43721,1699613570510 2023-11-10 10:55:45,628 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-10 10:55:45,628 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43721,1699613570510] 2023-11-10 10:55:45,628 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43721,1699613570510; numProcessing=1 2023-11-10 10:55:45,629 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43721,1699613570510 already deleted, retry=false 2023-11-10 10:55:45,629 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,43721,1699613570510 expired; onlineServers=0 2023-11-10 10:55:45,629 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,35827,1699613569566' ***** 2023-11-10 10:55:45,629 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-10 10:55:45,630 DEBUG [M:0;jenkins-hbase20:35827] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28d0999, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-11-10 10:55:45,630 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,35827,1699613569566 2023-11-10 10:55:45,630 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,35827,1699613569566; all regions closed. 2023-11-10 10:55:45,630 DEBUG [M:0;jenkins-hbase20:35827] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-10 10:55:45,630 DEBUG [M:0;jenkins-hbase20:35827] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-10 10:55:45,630 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-10 10:55:45,630 DEBUG [M:0;jenkins-hbase20:35827] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-10 10:55:45,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699613571878] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699613571878,5,FailOnTimeoutGroup] 2023-11-10 10:55:45,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699613571878] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699613571878,5,FailOnTimeoutGroup] 2023-11-10 10:55:45,630 INFO [M:0;jenkins-hbase20:35827] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-10 10:55:45,630 INFO [M:0;jenkins-hbase20:35827] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-10 10:55:45,630 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-10 10:55:45,630 INFO [M:0;jenkins-hbase20:35827] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-11-10 10:55:45,630 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-10 10:55:45,631 DEBUG [M:0;jenkins-hbase20:35827] master.HMaster(1512): Stopping service threads 2023-11-10 10:55:45,631 INFO [M:0;jenkins-hbase20:35827] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-10 10:55:45,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-10 10:55:45,631 ERROR [M:0;jenkins-hbase20:35827] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-10 10:55:45,632 INFO [M:0;jenkins-hbase20:35827] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-10 10:55:45,632 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-10 10:55:45,632 DEBUG [M:0;jenkins-hbase20:35827] zookeeper.ZKUtil(398): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-10 10:55:45,632 WARN [M:0;jenkins-hbase20:35827] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-10 10:55:45,632 INFO [M:0;jenkins-hbase20:35827] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-10 10:55:45,632 INFO [M:0;jenkins-hbase20:35827] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-10 10:55:45,632 DEBUG [M:0;jenkins-hbase20:35827] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-10 10:55:45,632 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:55:45,633 DEBUG [M:0;jenkins-hbase20:35827] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:55:45,633 DEBUG [M:0;jenkins-hbase20:35827] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-10 10:55:45,633 DEBUG [M:0;jenkins-hbase20:35827] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:55:45,633 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.12 KB heapSize=598.95 KB 2023-11-10 10:55:45,729 INFO [RS:0;jenkins-hbase20:43721] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,43721,1699613570510; zookeeper connection closed. 2023-11-10 10:55:45,729 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-10 10:55:45,729 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): regionserver:43721-0x101bb1fc0340001, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-10 10:55:45,730 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5a8e0b23] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5a8e0b23 2023-11-10 10:55:45,730 INFO [Listener at localhost/37195] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-10 10:55:46,041 INFO [M:0;jenkins-hbase20:35827] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.12 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7d3da5225d414e068a41886e168c07ad 2023-11-10 10:55:46,048 INFO [M:0;jenkins-hbase20:35827] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d3da5225d414e068a41886e168c07ad 2023-11-10 10:55:46,050 DEBUG [M:0;jenkins-hbase20:35827] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7d3da5225d414e068a41886e168c07ad as hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7d3da5225d414e068a41886e168c07ad 2023-11-10 10:55:46,056 INFO [M:0;jenkins-hbase20:35827] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d3da5225d414e068a41886e168c07ad 2023-11-10 10:55:46,057 INFO [M:0;jenkins-hbase20:35827] regionserver.HStore(1080): Added hdfs://localhost:38297/user/jenkins/test-data/2e40cf7e-704d-5fe4-c0d7-5fbe9c10bfa1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7d3da5225d414e068a41886e168c07ad, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-10 10:55:46,058 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegion(2948): Finished flush of dataSize ~513.12 KB/525434, heapSize ~598.93 KB/613304, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 424ms, sequenceid=1006, compaction requested=false 2023-11-10 10:55:46,058 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-10 10:55:46,058 DEBUG [M:0;jenkins-hbase20:35827] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-10 10:55:46,062 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-10 10:55:46,062 INFO [M:0;jenkins-hbase20:35827] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-10 10:55:46,063 INFO [M:0;jenkins-hbase20:35827] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35827 2023-11-10 10:55:46,065 DEBUG [M:0;jenkins-hbase20:35827] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,35827,1699613569566 already deleted, retry=false 2023-11-10 10:55:46,166 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-10 10:55:46,166 INFO [M:0;jenkins-hbase20:35827] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,35827,1699613569566; zookeeper connection closed. 2023-11-10 10:55:46,167 DEBUG [Listener at localhost/37195-EventThread] zookeeper.ZKWatcher(600): master:35827-0x101bb1fc0340000, quorum=127.0.0.1:62972, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-10 10:55:46,171 WARN [Listener at localhost/37195] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-10 10:55:46,177 INFO [Listener at localhost/37195] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-10 10:55:46,292 WARN [BP-806049384-148.251.75.209-1699613567068 heartbeating to localhost/127.0.0.1:38297] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-10 10:55:46,292 WARN [BP-806049384-148.251.75.209-1699613567068 heartbeating to localhost/127.0.0.1:38297] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-806049384-148.251.75.209-1699613567068 (Datanode Uuid 9f6465db-8ff1-4abd-ab07-c6e7ffad8768) service to localhost/127.0.0.1:38297 2023-11-10 10:55:46,294 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/dfs/data/data1/current/BP-806049384-148.251.75.209-1699613567068] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-10 10:55:46,295 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ddb86946-4b2e-17d3-9cfb-b2ae3cfd59fc/cluster_6fc29ba2-5c89-2fbb-ac11-b734e006aa17/dfs/data/data2/current/BP-806049384-148.251.75.209-1699613567068] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-10 10:55:46,322 INFO [Listener at localhost/37195] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-10 10:55:46,453 INFO [Listener at localhost/37195] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-10 10:55:46,540 INFO [Listener at localhost/37195] hbase.HBaseTestingUtility(1293): Minicluster is down